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PROACTIVE USER INTERFACE 
PRIORITY 

This application claims priority to a Provisional Application entitled "PROACTIVE 
USER INTERFACE", filed in the United States Patent and Trademark Office on 
September 5, 2003 and assigned Serial No. 60/500,669, the contents of which are hereby 
incorporated by reference. 

1. FIELD OF THE INVENTION 

The present invention is of a proactive user interface, and systems and methods 
thereof, particularly for use with mobile information devices. 

2. BACKGROUND OF THE INVENTION 

The use of mobile and portable wireless devices has expanded dramatically in recent 
years. Many such devices having varying functions, internal resources, and capabilities now 
exist, including, but not limited to mobile telephones, personal digital assistants, medical and 
laboratory instrumentation, smart cards, and set-top boxes. All such devices are mobile 
information devices. They tend to be special purpose, limited-function devices, rather than the 
general-purpose computing, machines that have been previously known. Many of these 
devices are connected to the Internet, and are used for a variety of applications. 

One example of such mobile information devices is the cellular telephone. Cellular 
telephones are fast becoming ubiquitous; use of cellular telephones is even surpassing that of 
traditional PSTN (public switched telephony network) telephones or "land line" telephones. 
Cellular telephones themselves are becoming more sophisticated, and in fact are actually 
computational devices with embedded operating systems. 

As cellular telephones become more sophisticated, the range of functions that they 
offer is also potentially becoming more extensive. However, currently these functions are 
typically related to extensions of functions already present in regular (land line) telephones, 
and/or the merging of certain functions of PDA's with those of cellular telephones. The user 
interface provided with cellular telephones is similarly non-sophisticated, typically featuring a 
keypad for scrolling through a few simple menus. Customization, although clearly desired by 
customers who have spent significant sums on personalized ring tones and other cellular 
telephone accessories, is still limited to a very few functions of the cellular telephone. 
Furthermore, cellular telephones currently lack automatic personalization, for example of the 
device user interface and custom/tailored functionalities that are required for better use of the 
mobile information device, and/or the ability to react according to the behavior of the user. 
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This lack of sophistication, however, is also seen with user interfaces for personal 
(desk top or laptop) computers and other computational devices. These computational 
devices can only usually be customized in very simple ways. Also, such customization must 
be performed by the user, who may not understand computer functions and/or may not feel 
comfortable performing such customization tasks. Currently, computational devices cannot 
learn patterns of user behavior and adjust their own behavior accordingly, as adaptive systems 
for the user interface. If the user cannot manually adjust the computer, then the user must 
adjust his/her behavior to accommodate the computer, rather than vice versa. 

Software which is capable of learning has been developed, albeit only for specialized 
laboratory functions. For example, "artificial intelligence" (AI) software has been developed. 
The term "AI" has been given a number of definitions, one of which is: "AI is the study of the 
computations that make it possible to perceive, reason, and act."(quoted in Artificial 
Intelligence A Modern Approach (second edition) by Stuart Russell , Peter Norvig (Prentice 
Hall, Pearson Education Inc, 2003). AI software combines several different concepts, such as 
perception, which provides an interface to the world in which the AI software is required to 
reason and act. Examples include but are not limited to, natural language processing - 
communicating, understanding document content and context of natural language; computer 
vision - perceive objects from imagery source; and sensor systems - perception of objects 
and features of perceived objects analyzing sensory data, etc). 

Another important concept is that of the knowledge base. Knowledge representation 
is responsible for representing extracting and storing the knowledge. This discipline also 
provides techniques to generalize knowledge, feature extraction and enumeration, object state 
construction and definitions. The implementation itself may be performed by commonly 
using known data structures, such as graphs, vectors, tables etc. 

Yet another important concept is that of reasoning. Automated reasoning combines 
the algorithms that use the knowledge representation and perception to draw new conclusions, 
infer questions answers and achieve the agent goals. The following conceptual frameworks 
are examples of AI reasoning: rule bases - system rules are evaluated against the knowledge 
base and perceived state for reasoning; search systems - the use of well known data structures 
for searching for an intelligent conclusion according to the perceived state, the available 
knowledge and goal (examples include decision trees, state graphs, minimax decision etc); 
classifiers - the target of the classifier reasoning system is to classify a perceived state 
represented as an experiment that has no classification tag. According to a pre-classified 
knowledge base the classifier will infer the classification of the new experiment (examples 
include vector distance heuristics, Support Vector Machine, Classifier Neural Network etc). 

Another important concept is for learning. The target of learning is improving the 
potential performance of the AI reasoning system by generalization over experiences. The 
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input of a learning algorithm will be the experiment and the output would be modifications of 
the knowledge base according to the results (examples include Reinforcement learning, Batch 
learning, Support Vector Machine etc). 

Some non-limiting examples of AI software implementation include (all of the below 
examples can be found in "An Artificial Intelligence: A Modern Approach", S. Russell and P. 
Norvig (eds), Prentice Hall, Pearson Education Inc., NJ, USA, 2003): 

Autonomous planning and scheduling: NASA's Remote Agent program became the first 
on-board autonomous planning program to control the scheduling of operations for a 
spacecraft. Remote Agent generated plans from high-level goals specified from the ground, 
and it monitored the operation of the spacecraft as the plans were executed - detecting, 
diagnosing, and recovering from problems as they occurred. 

Game playing: IBM's Deep Blue became the first computer program to defeat the world 
champion. 

Autonomous control: The ALVINN computer vision system was trained to steer a car to 
keep it following a lane. ALVINN computes the best direction to steer, based on experience 
from previous training runs. 

Diagnosis: Medical diagnosis programs based on probabilistic analysis have been able to 
perform at the level of an expert physician in several areas of medicine. 
Logistics Planning: During the Persian Gulf crisis of 1991, U.S forces deployed a Dynamic 
Analysis and Replanning Tool called DART, to do automated logistics planning and 
scheduling for transportation. 

Robotics: Many Surgeons new use robot assistant in microsurgery. HipNav is a system that 
uses computer vision techniques to create a tree-dimensional model of the patient's internal 
anatomy and then uses robotic control to guide the insertion of a hip replacement prosthesis. 
Language Understanding and problem solving: PROVERB is a computer program that 
solves crossword puzzles better than humans, using constraints in possible word fillers, a 
large database if past puzzles and a variety of information sources. 

Work has also been done for genetic algorithms and evolution algorithms for 
software. One example of such software is described in "Evolving Virtual Creatures", by 
Karl Sims (Computer Graphics, SIGGRAPH '94 Proceedings, July 1994, pp. 15-22). This 
reference described software "creatures" which could move through a three-dimensional 
virtual world, which is a simulated version of the actual physical world. The creatures could 
learn and evolve by using genetic algorithms, thereby changing their behaviors without 
directed external input. These genetic algorithms therefore delineated a hyperspace of 
potential behaviors having different "fitness" or rewards in the virtual world. The algorithms 
themselves were implemented by using directed graphs, which describe both the genotypes 
(components) of the creatures, and their behavior. 
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At the start of the simulation, many diff e r e nt cr e atur e s w ith diff e r e nt g e notyp es or e 
simulat e d. Th e creatur e s ar e allowed to alter th e ir b e havior in respons e to diff e r e nt otimuli in 
the virtual world. At e ach "generation", only certain creatur e s ar e allowed to survive, e ither 
according to a r e lative or ab s olute cut - off score, with the scor e being determined according to 

incr e as e th e fitness (and h e nce survivability) of th e mutat e d cr e atur e s, or vic e v e rsa. 
Mutations are also perform e d through the dir e ct e d graph, for example by randomly changing 
a valu e associated with a node, and/or adding or d e leting nod e s. Similarly, "mating" between 
creatures may result in changes to th e dir e cted graph. 

The results described in the reference showed that in fact virtual creatures could 
change and evolve. However, the creatures could only operate within their virtual world, and 
had no point of reference or contact with the actual physical world, and/or with human 
computer operators. 

SUMMARY OF THE PRESENT INVENTION 

The background art does not teach or suggest a system or method for enabling 
intelligent software at least for mobile information devices to learn and evolv e specifically for 
interacting with human users. The background art also does not teach or suggest a proactive 
user interface for a computational device, in which the proactive user interface learns the 
behavior of the user and is then able to actively suggest options to the user. The background 
art also does not teach or suggest an adaptive system for a mobile information device, in 
which the user interface is actively altered according to the behavior of the user. The 
background art also does not teach or suggest an intelligent agent for a mobile information 
device, which is capable of interacting with a human user through an avatar. 

The present invention overcomes these deficiencies of the background art by 
providing a proactive user interface, which could optionally be installed in (or otherwise 
control and/or be associated with) any type of computational device. The proactive user 
interface would actively make suggestions to the user, and/or otherwise engage in non- 
deterministic or unexpected behavior, based upon prior experience with a particular user 
and/or various preprogrammed patterns from which the computational device could select, 
depending upon user behavior. These suggestions could optionally be made by altering the 
appearance of at least a portion of the display, for example by changing a menu or a portion 
thereof; providing different menus for display; and/or altering touch screen functionality. The 
suggestions could also optionally be made audibly. Other types of suggestions or delivery 
mechanisms are possible. 
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By "suggestion" it should be noted that the system may actually optionally execute 
the action automatically, given certain user preferences and also depending upon whether the 
system state allows the specific execution of the action. 

Generally, it is important to emphasize that the proactive user interface preferably at 
least appears to be intelligent and interactive, and is preferably capable of at least somewhat 
"free" (e.g. non-scripted or partially scripted) communication with the user. An intelligent 
appearance is important in the sense that the expectations of the user are preferably fulfilled 
for interactions with an "intelligent" agent/device. These expectations may optionally be 
shaped by such factors as the ability to communicate, the optional appearance of the interface, 
the use of anthropomorphic attribute(s) and so forth, which are preferably used to increase the 
sense of intelligence in the interactions between the user and the proactive user interface. In 
terms of communication received from the user, the proactive user interface is preferably able 
to sense how the user wants to interact with the mobile information device. Optionally, 
communication may be in only one direction; for example, the interface may optionally 
present messages or information to the user, but not receive information from the user, or 
alternatively the opposite may be implemented. Preferably, communication is bi-directional 
for preferred interactions with the user. 

The intelligent agent preferably at least appears to be intelligent to the user. The 
intel ligence may optionally be provided throu g h a completely deterministic mechanism ; 
however, preferably the basis for at least the appearance of intelligence includes at least one 
or more random or semi-random elements. Again, such elements are preferably present in 
order to be consistent with the expectations of the user concerning intelligence with regard to 
the representation of the intelligent agent. 

For communication to the us e r, optionally and preferably the proactive interface ts 
capabl e of displaying or d e monstrating s initilat e d -e ra oi ions for interactions with th e u sefras 

pr e ferably simulat e d for pres e ntation by an int e llig e nt ag e nt, mor e pr e ferably r e present e d by 
an avatar or cr e ature. — The emotions are preferably created through an emotional system, 
which may optionally be at least partially controlled according to at least one us e r preference. 
Th e e motional system is preferably used in order for the r e actions and communications of the 
int e llig e nt agent to bo believabl e in t e rms of th e perception of the user; for example, if the 
int e llig e nt ag e nt is present e d as a dog like creature, the emotional system preferably e nabl e s 
th e emotions to be consistent with th e exp e ctations of th e user with regard to "dog lik e " 
behavior. 

Similarly, the intelligent agent pr e ferably at l e ast appears to b e intelligent to the user. 
The intelligence may optionally be provided through a completely deterministic mechanism; 
however, pref e rably the basis for at least the appearance of intelligence includes at least on e 
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or mor e random or s e mi random elementG. Again, such elements are preferably present in 
order to b e consistent with the e xpectations of th e user concerning intelligence with regard to 
the repres e ntation of the intellig e nt agent. 

Adaptiveness is preferably present, in order for the intelligent agent to be able to alter 
behavior at least somewhat for satisfying the request or other communication of the user. 
Even if the proactive user interface optionally does not include an intelligent agent for 
communicating with the user, adaptiveness preferably enables the interface to be proactive. 
Observation of the interaction of the user with the mobile information device preferably 
enables such adaptiveness to be performed, although the reaction of the proactive user 
interface to such observation may optionally and preferably be guided by a knowledge base 
and/or a rule base. 

As a specific, non-limiting but preferred example of such adaptiveness, particularly 
for a mobile information device which includes a plurality of menus, such adaptiveness may 
preferably include the ability to alter at least one aspect of the menu. For example, one or 
more shortcuts may optionally be provided, enabling the user to directly reach a menu choice 
while by-passing at least one (and more preferably all) of the previous menus or sub-menus 
which are higher in the menu hierarchy than the final choice. Optionally (alternatively or 
additionally), one or more menus may be rearranged according to adaptiveness of the 
proactive user interface, for example according to frequency of use. Such a rearrangement 
may optionally include moving a part of a menu, such as a menu choice and/or a sub-menu, to 
a new location that is higher in the menu hierarchy than the current location. Sub-menus 
which are higher in a menu hierarchy are reached more quickly, through the selection of 
fewer menu choices, than those which are located in a lower (further down) location in the 
hierarchy. 

Adaptiveness an^cn^emetiens-areis optionally and preferably assisted through the use 
of rewards for learning by the proactive user interface. Suggestions or actions of which the 
user approves preferably provide a reward, or a positive incentive, to the proactive interface 
to continue with such suggestions or actions; disapproval by the user preferably causes a 
disincentive to the proactive user interface to continue such behavior(s). Providing positive 
or negative incentives/disincentives to the proactive user interface preferably enables the 
behavior of the interface to be more nuanced, rather than a more "black or white" approach, 
in which a behavior would either be permitted or forbidden. Such nuances are also preferred 
to enable opposing or contradictory behaviors to be handled, when such behaviors are 
collectively approved/disapproved by the user to at least some extent. 

Another optional but preferred function of the proactive user interface includes 
teaching the user. Such teaching may optionally be performed in order to inform the user 
about the capabilities of the mobile user device. For example, if the user fails to operate the 
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device correctly, by entering an incorrect choice for example, then the teaching function 
preferably assists the user to learn how to use the device correctly. However, more preferably 
the teaching function is capable of providing instruction to the user about at least one non- 
device related subject. According to a preferred embodiment of the teaching function, 
instruction may optionally and preferably be provided about a plurality of subjects (or at least 
by changing the non-device related subject), more preferably through a flexible application 
framework. 

According to an optional but preferred embodiment of the present invention, a model 
of the user is preferably constructed through the interaction of the proactive user interface 
with the user. Such a model would optionally and preferably integrate AI knowledge bases 
determined from the behavior of the user and/or preprogrammed. Furthermore, the model 
would also optionally enable the proactive user interface to gauge the reaction of the user to 
particular suggestions made by the user interface, thereby adapting to the implicit preferences 
of the user. 

Non-limiting examples of such computational devices include ATM's (this also has 
security implications, as certain patterns of user behavior could set off an alarm, for example), 
regular computers of any type (such as desktop, laptop, thin clients, wearable computers and 
so forth), mobile information devices such as cellular telephones, pager devices, other 
wireless communication devices, regular telephones having an operating system, PDA's and 
wireless PDA's, and consumer appliances having an operating system. Hereinafter, the term 
"computational device" includes any electronic device having an operating system and being 
capable of performing computations. The operating system may optionally be an embedded 
system and/or another type of software and/or hardware run time environment. Hereinafter, 
the term "mobile information device" includes but is not limited to, any type of wireless 
communication device, including but not limited to, cellular telephones, wireless pagers, 
wireless PDA's and the like. 

The present invention is preferably implemented in order to provide an enhanced user 
experience and interaction with the computational device, as well as to change the current 
generic, non-flexible user interface of such devices into a flexible, truly user friendly 
interface. More preferably, the present invention constructs the user interface in the form of 
an avatar which would interact with the user. 4s-4 mpl o m .e nted to provide an enhanced 
e motional e xp e rience of th e us e r with th e comp u tational device, for example according to the 
optional but pr e ferred e mbodim e nt of constructing th e us e r interface in the form of an avatar 
which would interact with the user. Th e present invention is therefor e capable of providing a 
"living d e vice" experi e nc e , particularly for mobile information devices such as cellular 

telephones for example. According to this embodiment, th e user may even form an 

emotional attachment to the "living device". 
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According to another embodiment of the present invention, there is provided a 
mobile information device which includes an adaptive system. Like the user interface above, 
it also relies upon prior experience with a user and/or preprogrammed patterns. However, the 
adaptive system is optionally and preferably more restricted to operating within the functions 
and environment of a mobile information device. 

Either or both of the mobile information device adaptive system and proactive user 
interfaces may optionally and preferably be implemented with g e netic algorithms, artificial 
intelligence (AI) algorithms, machine learning (ML) algorithms, l e arn e d behavior, and 
software/computational devices which can perform learned behavio r are capabl e of evolution . 
Either or both may also optionally provide an advanced level of voice commands, touch 
screen commands, and keyboard 'short-cuts'. 

According to another optional but preferred embodiment of the present invention, 
there is provided one or more intelligent agents for use with a mobile information device over 
a mobile information device network, preferably including an avatar (or "creature"; 
hereinafter these terms are used interchangeably) through which the agent may communicate 
with the human user. The avatar therefore preferably provides a user interface for interacting 
with the user. The intelligent agent preferably also includes an agent for controlling at least 
one interaction of the mobile information device over the network. This embodim e nt may 
optionally in clude a p lu r ality of su eh in t e lli ge n t a g e n ts b e ing con n ec t e d over t h e m ebik 
information d e vic e n e twork, th e r e by optionally forming a n e twork of such ag e nts. — Various 
applications may also optionally be provided through this embodiment, including but not 
limited to teaching in general and/or for learning how to use the mobile information device in 
particular, teaching languages, games, entertainment, filtering advertisements and other non- 
solicited messages, role-playing, and so forth, communication applications, community 
affpfeatiensrigaflresT-eirterta^ or an other 

plac e , filt e ring adv erti s eme nts and oth e r non soli c ite d m e ssag e s, rol e playing or oth e r 
int e ractiv e games ov e r the c e ll phon e n e twork, "chat" and m e eting functions, die ability to 
buy "presents" for the intelligent agents and otherwise accessorize the character, and so forth. 
In theory, the agents themselves could be given "pets" as accessories. 

The — intelligent — ag e nt s — could — a+se — optionally — assi s t — m — providing — various 
bu s in es s/promotiona l op p ort uniti e s for the cell phon e operators. — The agent s could also 
optionally an d preferab ly a s sist with instal li ng a nd operating software on cell phones, which 
is a n e w ar e a of comm e rc e . — For exampl e , th e agents could optionally assist with the 
determination of the proper type of mobile information device and other details that ar e 
essential for corr e ctly downloading and operating software. 

The intelligent agent could also optionally and preferably educate the user by 
teaching the user how to operate various functions on the mobile information device itself, for 
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example how to send or receive messages, use the alarm, and so forth. As described in 
greater detail below, such teaching functions could also optionally be extended to teach the 
user about information/functions external to the mobile information device itself. Preferably, 
such teaching functions are enhanced by communication between a plurality of agents in a 
network, thereby enabling the agents to obtain information distributed between agents on the 
network. 

Optionally and pr e ferably, — paym e nt — for th e ag e nt s — could be p e rform e d by 
subscription, but alternatively the agents could optionally be "fed" through actions that would 
be charged to the user's prepaid, account and/or billed to the us e r at the end of the month. 

Therefore, a number of different interactions are possible according to the various 
embodiments of the present invention. These interactions include any one or more of an 
interaction between the user of the device and an avatar or other character or personification 
of the device; an interaction between the user of the device and the device, for operating the 
device, through the avatar or other character or personification^.; interactio n s b e tw ee n two 
us e rs through their respective devic es , by communicating through the avatar, or oth e r 
character or personification of the d e vice; and interactions between two devices through th e ir 
resp e ctiv e int elli g e nt agents, optionally without any communication betw ee n users or ev e n 
between the agent and the user. — The interaction or interactions that are possible are 
determined according to the embodiment of the present invention, as described in greater 
detail below. 

The present invention benefits from the relatively restricted environment of a 
computational device and/or a mobile information device, such as a cellular telephone for 
example, because the parameters of such an environment are known in advance. Even if such 
devices are communicating through a network, such as a cellular telephone network for 
example, the parameters of the environment can still be predetermined. Currently, 
computational devices only provide a generic interface, with little or no customization 
permitted by even manual, direct intervention by the user. 

It should be noted that the term "software" may also optionally include firmware or 
instructions operated by hardware. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is herein described, by way of example only, with reference to the 
accompanying drawings, wherein: 

FIG. 1 is a schematic block diagram of an exemplary learning module according to 
the present invention; 

FIG. 2 is a schematic block diagram of an exemplary system according to the present 
invention for using the proactive user interface; 
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FIG. 3 shows an exemplary implementation of a proactive user interface system 
according to the present invention; 

FIG. 4 shows a schematic block diagram of an exemplary implementation of the 
adaptive system according to the present invention; 

FIGS. 5A and 5B show a schematic block diagram and a sequence diagram, 
respectively, of an exemplary application management system according to the present 
invention; 

FIGS. 6A and 6B show exemplary infrastructure required for the adaptive system 
according to the present invention to perform one or more actions through the operating 
system of the mobile information device and an exemplary sequence diagram thereof 
according to the present invention; 

FIGS. 7A-7C show exemplary events, and how they are handled by interactions 
between the mobile information device (through the operating system of the device) and the 
system of the present invention; 

FIG. 8 describes an exemplary structure of the intelligent agent (Figure 8A) and also 
includes an exemplary sequence diagram for the operation of the intelligent agent (Figure 
8B); 



FIGS. 9 A and 9B show two exemplary methods for selecting an action according to 
the present invention; 




FIGS. — 11 A 11C feature diagrams for describing an — e xemplary, illustrative 
implementation of an emotional system according to the present invention; 



FIG. 102 shows an exemplary sequence diagram for textual communication according 
to the present invention; 

FIGS. lBA and 1 13-B show an exemplary class diagram and an exemplary sequence 
diagram, respectively, for telephone call handling according to the present invention; 

FIGS. 124 A and 124B describe illustrative, non-limiting examples of the SMS 
message handling class and sequence diagrams, respectively, according to the present 
invention; 

FIG. 13§ provides an exemplary menu handling class diagram according to the 
present invention; 

FIG. 146 shows an exemplary game class diagram according to the present invention; 
FIGS. 152A shows an exemplary teaching machine class diagram and 157B shows an 
exemplary teaching machine sequence diagram according to the present invention; 
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FIGS. 18A 18C show an exemplary evolution class diagram, and an exemplary 
mutation and an ex e mplary hybrid sequence diagram, respectiv e ly, according to th e pres e nt 
invention; 

FIG. 19 shows an ex e mplary hybridization s e quence betwe e n int e lligent agents on 

FIGS. 20 26 show ex e mplary scr e enshots of an avatar or cr e atur e according to the 
pr e s e nt invention; 

FIG. 27 is a schematic block diagram of an exemplary intelligent agent system 
ac cordi ng to the present inv e ntion; 

FIG. 28 shows the sy s tem of Figure 27 in more detail: 

FIG. 1629 shows a schematic block diagram of an exemplary implementation of an 
action selection system according to the present invention; and 

FIGS. nJGA-173GB show some exemplary screenshots of the avatar according to the 
present invention on the screen of the mobile information device. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention is of a proactive user interface, which could optionally be 
installed in (or otherwise control and/or be associated with) any type of computational device. 
The proactive user interface actively makes suggestions to the user, based upon prior 
experience with a particular user and/or various preprogrammed patterns from which the 
computational device could select, depending upon user behavior. These suggestions could 
optionally be made by altering the appearance of at least a portion of the display, for example 
by changing a menu or a portion thereof; providing different menus for display; and/or 
altering touch screen functionality. The suggestions could also optionally be made audibly. 

The proactive user interface is preferably implemented for a computational device, as 
previously described, which includes an operating system. The interface optionally and 
preferably includes a user interface for communicating between the user and the operating 
system. The interface also preferably includes a learning module for detecting at least one 
pattern of interaction of the user with the user interface and for proactively altering at least 
one function of the user interface according to the detected pattern. Therefore, the proactive 
user interface can anticipate the requests of the user and thereby assist the user in selecting a 
desired function of the computational device. 

Optionally and preferably, at least one pattern is selected from the group consisting of 
a pattern determined according to at least one previous interaction of the user with the user 
interface, and a predetermined pattern, or a combination thereof. The first type of pattern 
represents learned behavior, while the second type of pattern may optionally be 
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preprogrammed or otherwise predetermined, particularly for assisting the user when a 
particular computational device is first being operated by the user. A third optional possible 
type of pattern would combine these two aspects, and would enable the pattern to be at least 
partially determined according to the user behavior, but not completely; for example, the 
pattern selection may optionally be guided according to a plurality of rules, and/or according 
to a restrictive definition of the possible world environment state and/or the state of the device 
and/or user interface (see below for a more detailed explanation). 

The user interface preferably features a graphical display, such that at least one 
function of the graphical display is proactively altered according to the pattern. For example, 
at least a portion of the graphical display may optionally and preferably be altered, more 
preferably by selecting a menu for display according to the detected pattern; and displaying 
the menu. The menu may optionally be selected by constructing a menu from a plurality of 
menu options, for example in order to create a menu "on the fly". 

The user interface may additionally or alternatively feature an audio display, such that 
altering at least one function of the user interface involves altering at least one audible sound 
produced by the computational device. 

The proactive user interface could optionally and preferably be implemented 
according to a method of the present invention, which is preferably implemented for a 
proactive interaction between a user and a computational device through a user interface. The 
method preferably includes detecting a pattern of user behavior according to at least one 
interaction of the user with the user interface; and proactively altering at least one function of 
the user interface according to the pattern. 

According to another embodiment of the present invention, there is provided a mobile 
information device which includes an adaptive system. Like the user interface above, it also 
relies upon prior experience with a user and/or preprogrammed patterns. However, the 
adaptive system is optionally and preferably more restricted to operating within the functions 
and environment of a mobile information device, such as a cellular telephone for example, 
which currently may also include certain basic functions from a PDA. 

The adaptive system preferably operates with a mobile information device featuring 
an operating system. The operating system may optionally comprise an embedded system. 
The mobile information device may optionally comprise a cellular telephone. 

The adaptive system is preferably able to analyze the user behavior by analyzing a 
plurality of user interactions with the mobile information device, after which more preferably 
the adaptive system compares the plurality of user interactions to at least one predetermined 
pattern, to see whether the predetermined pattern is associated with altering at least one 
function of the user interface. Alternatively or additionally, the analysis may optionally 
include comparing the plurality of user interactions to at least one pattern of previously 
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detected user behavior, wherein the pattern of previously detected user behavior is associated 
with altering at least one function of the user interface. 

The function of the user interface may optionally comprise producing an audible 
sound by the mobile information device, which is more preferably selected from the group 
consisting of at least one of a ring tone, an alarm tone and an incoming message tone. 
Alternatively or additionally, this may optionally be related to a visual display by the mobile 
information device. The visual display may optionally include displaying a menu for 
example. 

The adaptive system may optionally, but not necessarily, be operated by the mobile 
information device itself. Alternatively, if the mobile information device is connected to a 
network, the adaptive system may optionally be operated at least partially according to 
commands sent from the network to the mobile information device. For this implementation, 
preferably data associated with at least one operation of the adaptive system is stored at a 
location other than the mobile information device, in which the location is accessible through 
the network. 

According to preferred embodiments of the present invention, the adaptive system 
also includes a learning module for performing the analysis according to received input 
information and previously obtained knowledge. Such knowledge may optionally have been 
previously obtained from the behavior of the user, and/or may have been communicated from 
another adaptive system in communication with the adaptive system of the particular mobile 
information device. The adaptive system optionally and preferably adapts to user behavior 
according to any one or more of an AI algorithm, a machine learning algorithm, or a genetic 
algorithm. 

According to another optional but preferred embodiment of the present invention, 
there is provided one or more intelligent agents for use with a mobile information device over 
a mobile information device network, preferably including an avatar through which the agent 
may communicate with the human user. The avatar therefore preferably provides a user 
interface for interacting with the user. The intelligent agent preferably also includes an agent 
for controlling at least one interaction of the mobile information device over the network. 
This embodiment may optionally include a plurality of such avatars being connected over the 
mobile information device network. 

According to pr e f e rr e d embodiments of th e pres e nt inv e ntion, both of th e avatar and 
the ag e nt are op e rat e d by th e mobil e information devic e . Alt e rnatively or additionally, th e 
mobile information device is in communication with at least one other mobil e information 
device which has a second agent, such that the first and second agents are pr e f e rably capable 

of communicating with each other. Such communication may optionally be performed 

dir e ctly, for example through an infra red communication directly betwe e n two mobil e 
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information devic e s, or alternatively or additionally through th e mobil e information d e vic e 
network. For e xample, if th e n e twork is a c e llular t e lephone network, communication may 
optionally be perform e d by using standard communication protocol s , IP/HTTP. SMS and so 

Furthermor e , optionally an d m o re preferably, the users of the resp e ctive mob ile 
information d e vic e s are pref e rably abl e to communicate through th e ir respective avatars. 
Such communication may optionally b e r e lated to a game, such as a rol e playing game. 

Similarly to the previously described adaptive system, one or both of the avatar and 
the agent may optionally be op e rated at least partially according to commands sent from the 
mobile information device network to the mobile information device. Also, optionally data 
associat e d with at least on e op e ration of at l e ast on e of th e avatar or th e agent is stor e d at a 
location other than the mobile information device, said location being acc e ssible through th e 



According to pr e f e rred embodiments of th e pr e s e nt inv e ntion, at l e a s t on e 
charact e ristic of an appearanc e of the avatar is pref e rably alterable, for example optionally 
according to a user command. Optionally and more preferably, a plurality of characteristics 
o f an app earanc e of avatar is alter a ble according to a predefined avatar skin. Th e skin is 
option al ly pr e d e fin e d by the user. By "skin" it is m e ant that a plurality of the characteristic s 
is altered to g ethe r a s a s etr4fr-whieh-#ie--sefrfem com b i n ed 
with th e previous e mbodim e nt of ha vi ng at l e ast a portion of t h e data r e lat e d to the avatar 

avatar onto different phones, and/or customize the appearance of the avatar for different 
r e asons, for e xampl e for special occasions such as a party or other c e lebration. Of course, 
th e s e are only intend e d as e xamples and are not meant to be limiting in any way. 

Aeeording to other^ptioftai^t^pB?ferr ed e mbodim e nts of th e pr e s e nt inv e ntion, at 



automat e d e volutionary algorithm, for example a genetic algorithm. — Th e evolutionary 
algorithm is one non limiting example of a method for providing personalization of the avatar 
for the user. Personalization may also optionally be performed through direct user selection 
of one or more characteristics or skins (groups of characteristics). — Such personalization i s 
desirable at least in part becaus e it enhances the emotional experience of the us e r with th e 
avatar and hence with th e mobile information device. 

According to still oth e r optional but pr e ferred e mbodim e nts of th e pr e s e nt inv e ntion, 
the mobile information device network comprises a locator for deteimining a physical 
location of the mobile information device, such that the user is preferably able to requ e st 
information about this physical location through an action of the agent. The locator is also 
pr e f e rably capable of d e termining a second physical location relativ e to the physical location 





yis tic of an appearanc e o f th e a vatar i s pr e ferably alt e rabl e according to an 
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of th e mobile information d e vice, such that the user is able to r e qu e st information about the 
second physical location through an action of the agent. 

Optional ly a n d preferably the us er can s e lect a n d request the second physical location 
a ccording to a category, which may optionally be s e l e ct e d from the group consisting of a 
co mmercia l l o cati o n , a medic al l o cati on, and a p u b lic safet y location, such as a fire or polic e 
station for e xampl e . 

For e xampl e if th e us e r wish e s to find a commercial location, the us e r would ent e r a 
request for such a location, optionally by name of a store, shopping mail, etc. or alternatively 
according to a typ e of comm e rcial location, such as a type of store, or even a general category 
such as "shopping mall" for e xample. Optionally, a matching commercial location could send 
a m es sage to the mobile i n fo rm atio n devic e according to s aid action of said agent, for 
example optionally and pr e ferably including at l e ast on e of an advertisement or a coupon, or a 
€~0H*bina&en~4beree-k — Fofr-Siieh-messa g es, or i ndee d for any typ e of m e ssag e , th e ag ent 
preferabl y filt e rs th e m e ssag e according to at least on e crit e rion, which is mor e pref e rably 
e ntered by the user through the avatar, and/or i s learned by th e avatar in r e sponse to a 
previous action of the user upon receiving a message. The avatar may then optionally pres e nt 
at le ast info rmati o n abou t th e me s sag e to the u serH^-n o t the mess ag e its e l f (in w f hole or in 

The-nreei^lse^referably-re^ about th e s ec o n d physical locatio n 

th r o ugh th e avatar. 

Of c o urse, th e com me r cial l o cation do e s not n ecess arily ne e d to b e a physical 
location; it could also optionally be a virtual commercial location, such a s for m commerce 
for e xample, wh e rein th e user communicat e s with the virtual comm e rcial location through th e 
avatar. — Pr e f e rably, th e us e r could p e rform a purcha s e at the virtual commercial location 
threugh-the a va tar — : Fke^*sef^euld^lso^ptfo^^ 

location by using th e ag e n t, al tho ugh again pref e rably using th e avatar a s the interface. As 
d e scrib e d abov e , th e avatar could e v e n optionally b e capable of r e ceiving an accessory 
purchased from the virtual commercial location. 

Also, if the mobile information device is capable of receiving softwar e , then the agent 
preferably p e rforms at least a portion of installation of the software on the mobil e information 
d e vice. Th e us e r may optionally int e ract with the avatar for performing at least a portion of 
configuration of the software. 

In terms of technical implementation, the present invention is preferably capable of 
operating on a limited system (in terms of memory, data processing capacity, screen display 
size and resolution, and so forth) in a device which is also very personal to the user. For 
example, preferably the device is a mobile information device, such as a cellular telephone, 
which by necessity is adapted for portability and ease of use, and therefore may have one or 
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more, or all, of the above limitations. The implementation aspects of the present invention 
are preferably geared to this combination of characteristics. Therefore, in order to overcome 
the limitations of the device itself while still maintaining the desirable personalization and 
"personal feel" for the user, various solutions are proposed below. It should be noted that 
these solutions are examples only, and are not meant to be limiting in any way. 

EXAMPLE 1: PROACTIVE INTERFACE - General 

The proactive user interface of the present invention is preferably able to control 
and/or be associated with any type of computational device, in order to actively make 
suggestions to the user, based upon prior experience with a particular user and/or various 
preprogrammed patterns from which the computational device could select, depending upon 
user behavior. These suggestions could optionally be made by altering the appearance of at 
least a portion of the display, for example by changing a menu or a portion thereof; providing 
different menus for display; and/or altering touch screen functionality. The suggestions could 
also optionally be made audibly. 

The proactive user interface is preferably implemented for a computational device, as 
previously described, which includes an operating system. The interface optionally and 
preferably includes a user interface for communicating between the user and the operating 
system. The interface is preferably able to detect at least one pattern of interaction of the user 
with the user interface, for example through operation of a learning module and is therefore 
preferably able to proactively alter at least one function of the user interface according to the 
detected pattern. Therefore, the proactive user interface can anticipate the requests of the user 
and thereby assist the user in selecting a desired function of the computational device. 

This type of proactive behavior, particularly with regard to learning the behavior and 
desires of the user, requires some type of learning capability on the part of the proactive 
interface. Such learning capabilities may optionally be provided through algorithms and 
methodologies which are known in the art, relating to learning (by the software) and 
interactions of a software object with the environment. Software can be said to be learning 
when it can improve its actions along time. Artificial Intelligence needs to demonstrate 
intelligent action selection (reasoning), such that the software preferably has the ability to 
explore its environment (its "world") and to discover action possibilities. The software also 
preferably has ability to represent the world's state and its own internal state. The software 
then is preferably able to select an intelligent action (using the knowledge above) and to act. 

Learning, for example by the learning module of the interface, can optionally and 
preferably be reinforced by rewards, in which the learning module is rewarded for taking 
particular actions according to the state of the environment. This type of learning actually 
involves training the learning module to behave in a certain manner. If more than one 
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behavior is allowed, then the learning process is non-deterministic and can create different 
behaviors. With regard to the proactive user interface, for example, optionally and preferably 
the reward includes causing the learning module to detect when an offered choice leads to a 
user selection, as opposed to when an offered choice causes the user to seek a different set of 
one or more selections, for example by selecting a different menu than the one offered by the 
proactive user interface. Clearly, the proactive user interface should seek to maximize the 
percentage of offerings which lead to a direct user selection from that offering, as this shows 
that the interface has correctly understood the user behavior. 

In order to assist in this process, preferably learning by the learning module is 
reinforced, for example according to the following optional but preferred reinforcement 
learning key features: 

Adaptive learning process - the learning process is iterative, such that for each 
iteration the learning module learns the appropriate action to perform. A change in the 
environment preferably leads to changes in behavior. The learning module can be trained to 
perform certain actions. 

Low memory consumption- reasoning system algorithms such as neural nets or MAS 
have small memory complexity, since environment state and internal state are reduced to a 
small set of numerical values. The algorithm doesn't require more memory during the 
learning process. 

Fast interaction - optionally, at each iteration an action is selected based on previous 
iteration's computation, thus little computation is done to select the next action. The user 
experiences a fast reactive program. The learning process for the next iteration is done after 
the action takes place. 

Utilization of device idle time - since the learning module can optionally learn by 
itself from the environment with no user interaction, idle computational device time can 
preferably be utilized for learning. 

Figure 1 is a schematic block diagram of an exemplary learning module according to 
the present invention for reactive learning. As shown, a learning module 100 preferably 
includes a Knowledge Base 102, which preferably acts as the memory of learning module 
100, by holding information gathered by learning module 100 as a result of interactions with 
the environment. Knowledge Base 102 may optionally be stored in non-volatile memory (not 
shown). Knowledge Base 102 preferably holds information that helps learning module 100 to 
select the appropriate action. This information can optionally include values such as 
numerical weights for an inner neural net, or a table with action reward values, or any other 
type of information. 

In order for learning module 100 to be able to receive information about the 
environment, learning module 100 preferably features a plurality of sensors 104. Sensors 104 



17 



678-1264 (PI 1404) 

preferably allow learning module 100 to perceive its environment state. Sensors 104 are 
connected to the environment and output sensed values. The values can come from the 
program itself (for example, position on screen, energy level etc.), or from real device values 
(for example, battery value and operating state, such as a flipper state for cellular telephones 
in which the device can be activated or an incoming call answered by opening a "flipper"). 

Sensors 104 clearly provide valuable information; however, this information needs to 
be processed before learning module 100 can comprehend it. Therefore, learning module 100 
preferably also includes a perception unit 106, for processing the current output of sensors 
104 into a uniform representation of the world, called a "state". The state is then preferably 
the input for a reasoning system 108, which may be described as the "brain" of learning 
module 100. This design supports the extension of the world state and the sensor mechanism, 
as well as supporting easy porting of the system to several host platforms (different 
computational devices and environments), such that the world state can be changed according 
to the device. 

Reasoning system 108 preferably processes the current state with Knowledge Base 
102, thereby producing a decision as to which action to perform. Reasoning system 108 
receives the current state of the world, outputs the action to be performed, and receives 
feedback on the action selected. Based on the feedback, reasoning system 108 preferably 
updates Knowledge Base 102. This is an iterative process in which learning module 100 
learns to associate actions to states. 

According to an optional embodiment of the present invention, the computational 
device may feature one or more biological sensors, for sensing various types of biological 
information about the user, such as emotional state, physical state, movement, etc. This 
information may then be fed to sensors 104 for assisting perception unit 106 to determine the 
state of the user, and hence to determine the proper state for the device. Such biological 
sensors may include but are not limited to sensors for body temperature, heart rate, oxygen 
saturation or any other type of sensor which measures biological parameters of the user. 

Figure 2 shows an exemplary embodiment of a system 200 according to the present 
invention for providing the proactive user interface, again featuring learning module 100. 
Learning module 100 is shown being in communication with an operating system 202 of the 
computational device (not shown) with which learning module 100 is associated and/or 
controls and/or by which learning module 100 is operated. Operating system 202 preferably 
controls the operation of a use^interface unit 204 and also at least one other software 
application 206 (although of course many such software applications may optionally be 
present). 

The user preferably communicates through ttseMnterface unit 204, for example by 
selecting a choice from a menu. Operating system 202 enables this communication to be 
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received and translated into data. Learning module 100 then preferably receives such data, 
and optionally sends a command back to operating system 202, for example to change some 
aspect of usef-interface unit 204 (for example by offering a different menu), and/or to operate 
software application 206. The user then responds through «sef-interface unit 204; from this 
response, learning module 100 preferably learns whether the action (command that was sent 
by learning module 100) was appropriate. 

Figure 3 is a schematic block diagram showing an exemplary implementation of a 
proactive user interface system 300 according to the present invention. As shown, system 
300 preferably features a three level architecture, with an application layer being supported by 
an AI (artificial intelligence) framework, which in turn communicates with the host platform 
computational device (shown as "host platform"). 

The application layer optionally and preferably features a plurality of different 
applications, of which a few non-limiting examples are shown, such as a MutateApp 302, a 
PreviousApp 304 and a TeachingApp 306. 

Mutat e App 3 0 2 is p r e ferably invoiced in order to control and/or initiate mutations in 
s y ste m 3 00. As noted above, th e learning module can optionally change it s b e havior through 
directed o r semi - directed e volution, for e xample through genetic algorithms. MutateApp 3 02 
pr e ferably controls and/or initiates such mutations through evolution. The embodiment of 
eveltttkm-is-des^ ibe-in-greater-deta i 1-beJ ewr 

ftrevie usApp 304 preferably e nabl e s a prior state of syst e m 300, or a portion th e r e of 

specifically, PreviousApp 304 enables the user to r e turn to the previous evolutionary st e p if 
th e pr e sent invention is being implemented with an evolutionary algorithm. More generally, 

feisteryH^fetteh-states-isi^re^^ 

TeachingApp 306 i s describ e d in gr e ater d e tail b e low, aft e r Exampl e 3, but may 
optionally be implemented in order to teach the user about how to operate the computational 
device, and/or about a different subject, external to the computational device. TeachingApp 
306 provides a teaching application which, in combination with the AI infrastructure 
described below, provides a personalized learning experience. TeachingApp 306 preferably 
can adjust the type of teaching, teaching methods, rate of imparting new information, 
reinforcement activities and practice activities, and so forth, to meet the individual needs of 
the particular user. Furthermore, TeachingApp 306 may also optionally be able to adjust 
performance for a plurality of different users, for example in a group or classroom learning 
situation. 

TeachingApp 306 is only one non-limiting example of a generic application which 
may be implemented over the AI framework layer. 
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The AI framework layer itself contains one or more components which enable the 
user interface to behave in a proactive manner. Optionally and preferably, the framework 
includes a DeviceWorldMapper 308, for determining the state of the computational device 
and also that of the virtual world, as well as the relationship between the two states. 
DeviceWorldMapper 308 preferably receives input, for example from various events from an 
EventHandler 310, in order to determine the state of the virtual world and that of the device. 

DeviceWorldMapper 308 also preferably communicates with an AI/ML (machine 
learning) module 312 for analyzing input data. AI/ML module 312 also preferably 
determines the behavior of system 300 in response to various stimuli, and also enables system 
300 to learn, for example from the response of the user to different types of user interface 
actions. The behavior of system 3 0 0 may also optionally mid preferably be improved 





3&e^mbedHtteftfr-of-^ wi th re g ar d to th e use of an 

intellig e nt ag e nt on a mobil e information d e vic e (see b e low for on e xampl e ), but may also 
optionally be used with any proactiv e user interface for a computational device. Pref e rably, 
this embodim e nt is used when the proactive user interface also features or is used in 
co m bina tion with an av ata r . 

Evolu t i o n i s preferably simulated by a set of g e netic algorithms. The basis of these 
algorith m s is describing the p roperti es of th e p roacti v e interface (a nd particula rfy-the-avatai^ 
app e aran ce ) i n t e rm of g e n es , chromosom es, and ph e n ot ypes. Th e gone is a discret e prop e rty 
th at has a l e v e l of e xpr e ssi o n for e xampl e a le g of a c e rtain t yp e . Th e l e v e l of e xpr e ssion can 
be the n umber of these l e gs. 

A phcnotyp c is the external expression of a g e ne; for exampl e the leg gene can hav e 
diff e r e nt phenotypes in term of leg l e ngth or size. 



T%e-gene-emi-opiiotKi4ty^ . T hi s pro ce ss (pr efe rabl y 



according to a c e rtain probability) chang e s on e or more param e t e r of th e g e n e , th e r e by 



A chromosome is a set of genes that function together. The chromosome can hybrid 

(cro s s breeding) with the same type of chromosom e from a different creature, thus creating a 
new chromosom e that is a combination of its g e netic parent chromosomes. 

This methodology helps in creating a generic infra s tructure to simulate visual 
e volution (for e xample of the app e arance of the avatar) and/or e volution of the behavior of th e 
proactive us e r int e rfac e . Th e s e algorithms may also optionally b e us e d for d e t e rmining non 
visual behavioral characteristics, such as dexterity, stamina and so on. The effect could 
optionally result for example in a faster creature, or a more efficient creature. — These 
algorithms may optionally be used for any such characteristics that can be describ e d 
according to th e previou s ly m e ntioned gen e /genotyp o /phenotype structure, such that for 






producing 



diff e r e nt 



phenotyp e s. 
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e xample b e havioral g e n e s could optionally determin e th e behavior of AI algorithms us e d by 
th e present invention. 

T h e algor it hm output pr e f e rably provides a variety of possibl e descendant avatars 



T h e g eneti c algorithms us e a natural selection proc ess t o decide which of th e genetic 
childr e n will continu e as th e n e xt g e neration. The selection proc e s s can be d e cid e d by the user 
or can b e pr e d e fin e d. In this way th e cr e atur e can display inter e sting e volution b e havior. Th e 
g e neric algorithm fram e work can be used to evolve genes that encode other non visual 
properties of th e creature, such a s g o als or character. 

Evolution module 314 supports and also preferably manages such evolution, for 



Between these different Al-type applications and EventHandler 310, one or more 
different low level managers preferably support the receipt and handling of different events, 
and also the performance of different actions by system 300. These managers may optionally 
include but are not limited to, an ActionManager 316, a UIManager 318, a StorageManager 
320 and an ApplicationManager 322. 

ActionManager 316 is described in greater detail below, but briefly preferably 
enables system 300 to determine which action should be taken, for example through the 
operation of AI/ML module 312. 

UIManager 318 preferably manages the appearance and functions of the user 
interface, for example by directing changes to that interface as previously described. 

StorageManager 320 preferably manages the storage and handling of data, for 
example with regard to the knowledge base of system 300 (not shown). 

ApplicationManager 322 preferably handles communications with the previously 
described applications in the application layer. 

All of these different managers preferably receive events from EventHandler 310. 

Within the AI framework layer, an AI infrastructure 324 optionally and preferably 
supports communication with the host platform. The host platform itself preferably features a 
host platform interface 326, which may optionally and preferably be provided through the 
operating system of the host platform for example. 

AI infrastructure 324 optionally and preferably includes an I/O module 328, for 
receiving inputs from host platform interface 326 and also optionally for sending commands 
to host platform interface 326. A screen module 330 preferably handles the display of the 
user interface on the screen of the host platform computational device. A resources module 
332 preferably enables system 300 to access various host platform resources, such as data 
storage and so forth. 
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Of course, the above Figures represent only one optional configuration for the 
learning module. For example, the learning module may also be represented as a set of 
individual agents, in which each agent has a simple goal. The learning module chooses an 
agent to perform an action based on the current state. The appropriate mapping between the 
current state and agents can also be learned by the learning module with reinforcement 
learning. 

Learning may also optionally be supervised. The learning module may hold a set of 
examples how to behave and can then learn the pattern given from the supervisor. After the 
learning module learns the rules, it tries to act based on the information it has already seen, 
and to generalize new states. 

EXAMPLE 2: ADAPTIVE SYSTEM FOR MOBILE INFORMATION DEVICE 

This example relates to the illustrative implementation of an adaptive system of the 
present invention with a mobile information device, although it should be understood that this 
implementation is preferred but optional, and is not intended to be limiting in any way. 

The adaptive system may optionally include any of the functionality described above 
in Example 1, and may also optionally be implemented as previously described. This 
Example focuses more on the actual architecture of the adaptive system with regard to the 
mobile information device operation. Also, this Example describes an optional but preferred 
implementation of the creature or avatar according to the present invention. 

The next sections describe optional but preferred embodiments of specific technical 
implementations of various aspects of the adaptive system according to the present invention. 
For the purpose of description only and without any intention of being limiting, these 
embodiments are based upon the optional but preferred embodiment of an adaptive system 
interacting with the user through an intelligent agent, optionally visually represented as an 
avatar or "creature". 

Section 1 : Event Driven System 

This Section describes a preferred embodiment of an event driven system according 
to the present invention, including but not limited to an application manager, and interactions 
between the device itself and the system of the present invention as it is operated by the 
device. 

Figure 4 shows a schematic block diagram of an exemplary adaptive system 400 
according to the present invention, and interactions of system 400 with a mobile information 
device 402. Also as shown, both system 400 and mobile information device 402 preferably 
interact with a user 404. 
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Mobile information device 402 optionally and preferably has a number of standard 
functions, which are shown divided into two categories for the purpose of explanation only: 
data and mechanisms. Mechanisms may optionally include but are not limited to such 
functions as a UI (user interface) system 406 (screen, keypad or touchscreen input, etc); 
incoming and outgoing call function 408; messaging function 410 for example for SMS; 
sound 412 and/or vibration 414 for alerting user 404 of an incoming call or message, and/or 
alarm etc; and storage 416. 

Data may optionally include such information as an address (telephone) book 418; 
incoming or outgoing call information 420; the location of mobile information device 402, 
shown as location 422; message information 424; cached Internet data 426; and data about 
user 404, shown as owner data 428. 

It should be noted that mobile information device 402 may optionally include any one 
or more of the above data/mechanisms, but may not necessarily include all of them, and/or 
may include additional data/mechanisms that are not shown. These are simply intended as 
non-limiting examples with regard to mobile information device 402, particularly for cellular 
telephones. 

Adaptive system 400 according to the present invention preferably interacts with the 
data/mechanisms of mobile information device 402 in order to be able to provide an adaptive 
(and also preferably proactive) user interface, thereby increasing the ease and efficiency with 
which user 404 interacts with mobile information device 402. 

Adaptive system 400 preferably features logic 430, which preferably functions in a 
similar manner as the previously described learning module, and which also optionally and 
preferably operates according to the previously described AI and machine learning 
algorithms. 

Logic 430 is preferably able to communicate with knowledge base 102 as described 
with regard to Figure 1 (components featuring the same reference numbers have either 
identical or similar functionality, unless otherwise stated). Information storage 432 preferably 
includes data about the actions of mobile information device 402, user information and so 
forth, and preferably supplements the data in knowledge base 102. 

Preferably, adaptive system 4 00 is capable of evolution, through an evolution logic 
4 3 4 , which may optionally combine the previously describ e d functionality of evolution 



Optionally, adaptive system 400 is capable of communicating directly with user 404 
through text and/or audible language, as supported by a language module 436. 

Particularly as described with regard to the embodiment of the present invention in 
Example 3 below, but a Also optionally for adaptive system 400, user 404 may optionally be 
presented with an avatar (not shown) for the user interface. If present, such an avatar may 
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optionally be created through a 3D graphics model 438 and an animation module 440 (see 
below for more details). Th e avatar may optionally b e p e rsonalized for us e r 4 0 4 , th e r e by 
providing an e nhanced emotional e xp e ri e nce for user 4 0 4 when interacting with mobil e 

Figure 5A shows a schematic block diagram of an exemplary application 
management system 500, which is a core infrastructure for supporting the adaptive system of 
the present invention. System 500 may also optionally be used for supporting such 
embodiments as teaching application functionality, as previously described and also as 
described in greater detail below. System 500 preferably features an application manager 
502 for managing the different types of applications which are part of the adaptive system 
according to the present invention. Application manager 502 communicates with an 
application interface called BaseApp 504, which is implemented by all applications in system 
500. Both application manager 502 and BaseApp 504 communicate events through an 
EventHandler 506. 

Application manager 502 is responsible for managing and providing runtime for the 
execution of the system applications (applications which are part of system 500). The life 
cycle of each such application is defined in BaseApp 504, which allows application manager 
502 to start, pause, resume and exit (stop) each such application. Application manager 502 
preferably manages the runtime execution through the step method of the interface of 
BaseApp 504. It should be noted that optionally and preferably the step method is used for 
execution, since system 500 is preferably stateful, such that each step preferably corresponds 
(approximately) to one or more states. However, execution could also optionally be based 
upon threads and/or any type of execution method. 

Application manager 502 receives a timer event from the mobile information device. 
As described in greater detail below, preferably the mobile information device features an 
operating system, such that the timer event is preferably received from the operating system 
layer. When a timer is invoked, application manager 502 invokes the step of the current 
application being executed. Application manager 502 preferably switches from one 
application to another application when the user activates a different application, for example 
when using the menu system. 

Some non-limiting examples of the system applications are shown, including but not 
limited to, a TeachingMachineApp 508, a MutateApp 510, a GeneStudioApp 514, a 
TWizardApp 516, a FloatingAgentApp 518 and^ a TCWorldApp 522 and a HybridApp 520 . 
These applications arc also described in greater detail below with regard to Example 3. 

MutateApp 510 i s pr e ferably invoked in order to control and/or initiate mutations in 
th e adaptive system, and/or in the app e arance of an avatar repr e s e nting the adaptive system as 
a user int e rface. As noted above with regard to Example L th e adaptive system of the present 
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invention can optionally change its b e havior through directed or semi directed evolution, for 
exampl e through gen e tic algorithms. MutateApp 510 pref e rably controls and/or initiat e s such 
mutations. 

G e n e StudioApp 51 4 preferably e nabl es the user to perform directed and/or semi 
feeeted mu t at ions thro ug h one or m or e ma nu a l c ommands. For e xample, th e u se r may wish 
to direct th e adaptive syst e m (through application managem e nt system 500) to perform a 
particular task sequenc e upon receiving a particular input. Alt e rnativ e ly, th e u se r may wish to 
directly change part of the app e arance of an avatar, if present. — According to preferred 
e mbodiments of the present invention, these different aspects of the adaptive system ar e 
preferably implemented by di s tinct "genes", which can then optionally be altered by the user. 

HybridApp 5 20 may optionally be invoked if th e user wi s h e s to r e c e ive information 
from an e xternal source, such as the adaptive system of another mobil e information devic e , 
and~te>--ffle rg e thi s iiifo rmatieft-with existin g inioH^tiei^i^ 

d e vice. For exampl e, th e user - may wish to cr e at e an avatar having a hybrid app e aranc e with 
the avatar of another mobile information devic e . HybridApp 520 also optionally and 
preferably provides the main control of the user on the entire evolutionary state of the avatar. 
Optionally and more pr e fe ra bly , HybridApp 5 20 may be used t o ins tr u ct th e us e r on th e "lif e " 
prop e rti e s of with th e avatar, which - may o p t i o nally have a name, personality, behavior and 
appearance 

TeachingMachineApp 508 is an illustrative, non-limiting example of an application 
which may optionally relate to providing instruction on the use of the device itself, but 
preferably provides instruction on a subject which is not related to the direct operation of the 
device itself. Therefore, TeachingMachineApp 508 represents an optional example of an 
application which is provided on the mobile information device for a purpose other than the 
use of the device itself. 

TCWorldApp 522 is an application which runs the intelligent agent, preferably 
controlling both the intelligent aspects of the agent and also the graphical display of the 
creature or avatar (both are described in greater detail below). 

Other non-limiting examples of the applications according to the present invention 
include games. One non-limiting example of a game, in which the adaptive system and the 
user can optionally interact together, is a "Hide and Seek" game. The "Hide and Seek" game 
is preferably performed by having the creature or avatar "hide" in the menu hierarchy, such 
that the user preferably traverses at least one sub-menu to find the avatar or creature, thereby 
causing the user to learn more about the menu hierarchy and structure. Many other such 
game applications are possible within the scope of the present invention. 

TWizardApp 51 6 i s another typ e of application which provides information to the 
us e r. It is d e scrib e d with regard to the Start Wizard application in Example 4 below. Briefly, 
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this application contains the us e r pr e f e rences and configuration of tho AI fram e work, ouch as 
th e charact e r of th e int e lligent agent, particularly with regard to th e emotional system (also 
described in gr e ater detail below), and al s o with regard to s etti ng goa l prioritie s (d e scrib e d in 
gr e at e r d e tail below). 

FloatingAgentApp 518 optionally and preferably controls the appearance of the user 
interface, particularly with regard to the appearance of an avatar (if present). 
FloatingAgentApp 518 enables the visual display aspects of the user interface to be displayed 
independently of the display of the avatar, which may therefore appear to "float" over the user 
interface for example. FloatingAgentApp 518 preferably is the default application being 
operated when no other application is running. 

Figure 5B shows an exemplary sequence diagram for the operations of the application 
manager according to the present invention. As shown, an EventHandler 506 preferably 
dispatches a notification of an event to application manager 502, as shown in arrow 1. If the 
event is a timer event, then application manager 502 invokes the step (action) of the instance 
of the relevant application that was already invoked, as shown in arrow 1.1.1. If the event is 
to initiate the execution of an application, then application manager 502 invokes an instance 
of the relevant application, as shown in arrow 1.2.1. If a currently running instance of an 
application is to be paused, then application manager 502 sends the pause command to the 
application, as shown in arrow 1.3.1. If a previously paused instance of an application is to be 
resumed, then application manager 502 sends the resume command to the application, as 
shown in arrow 1.4.1. In any case, successful execution of the step is returned to application 
manager 502, as shown by the relevant return arrows above. Application manager 502 then 
notifies EventHandler 506 of the successful execution, or alternatively of failure. 

These different applications are important for enabling the adaptive system to control 
various aspects of the operation of the mobile information device. However, the adaptive 
system also needs to be able to communicate directly with various mobile information device 
components, through the operating system of the mobile information device. Such 
communication may optionally be performed through a communication system 600, shown 
with regard to Figure 6, preferably with the action algorithms described below. 

Figures 6A and 6B show an exemplary implementation of the infrastructure required 
for the adaptive system according to the present invention to perform one or more actions 
through the operating system of the mobile information device (Figure 6A), as well as a 
sequence diagram for operation of communication system 600 (Figure 6B). According to 
optional but preferred embodiments of the present invention, this infrastructure is an example 
of a more general concept of "AI wrappers", or the ability to "wrap" an existing UI (user 
interface) system with innovative AI and machine learning capabilities. 
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Communication system 600 is preferably capable of handling various types of events, 
with a base class event 602 that communicates with EventHandler 506 as previously 
described. EventDispatcher 604 then routes the event to the correct object within the system 
of the present invention. Routing is preferably determined by registration of the object with 
EventDispatcher 604 for a particular event. EventDispatcher 604 preferably manages a 
registry of handlers that implement the EventHandler 506 interface for such notification. 

Specific events for which particular handlers are implemented optionally and 
preferably include a flipper event handler 606 for cellular telephones in which the device can 
be activated or an incoming call answered by opening a "flipper"; when the flipper is opened 
or closed, this event occurs. Applications being operated according to the present invention 
may optionally send events to each other, which are preferably handled by an InterAppEvent 
handler 608. An event related to the optional but preferred e volution (chang e ) of the creature 
ei^vfltar4s^mferably4iaftd ted by an Evo ki tionEv e nt h a ftd lef-61 Ot— An incoming or outgoing 
telephone call is preferably handled by a CallEvent handler 612, which in turn preferably has 
two further handlers, a CallStartedEvent handler 614 for starting a telephone call and a 
CallEndedEvent handler 616 for ending a telephone call. 

Ah SMS event (incoming or outgoing message) is preferably handled by an 
SMSEvent handler 618. Optional but preferred parameters which may be included in the 
event comprise parameters related to hybridization of the creature or avatar of one mobile 
information device with the creature or avatar of another mobile information device, as 
described in greater detail below. 

Events related to operation of the keys are preferably handled by a KeyEvent handler 
620 and/or a KeyCodeEvent handler 622. For example, if the user depresses a key on the 
mobile information device, KeyEvent handler 620 preferably handles this event, which relates 
to incoming information for the operation of the system according to the present invention. In 
the sequence diagram, the key_event is an object from class KeyEvent, which represents the 
key event message object. KeyEvent handler 620 handles the key_event itself, while 
KeyCodeEvent handler 622 listens for input code (both input events are obtained through a 
hook into the operating system). 

A BatteryEvent handler 624 preferably handles events related to the battery, such as a 
low battery, or alternatively switching from a low power consumption mode to a high power 
consumption mode. 

DayTimeEvent handler 626 preferably relates to alarm, calendar or 
reminder/appointment diary events. 

Figure 6B is an exemplary sequence diagram, which shows how events are handled 
between the mobile information device operating system or other control structure and the 
system of the present invention. In this example, the mobile information device has an 
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operating system, although a similar operation flow could optionally be implemented for 
devices that lack such an operating system. If present, the operating system handles input and 
output to/from the device, and manages the state and events which occur for the device. The 
sequence diagram in Figure 6B is an abstraction for facilitating handling of, and relating to, 
these events. 

An operating system module (os_module) 628 causes or relates to an event; 
optionally a plurality of such modules may be present, but only one is shown for the purposes 
of clarity and without intending to be limiting in any way. Operating system module 628 is 
part of the operating system of the mobile information device. Operating system module 628 
preferably sends a notification of an event, whether received or created by operating system 
module 628, to a hook 630. Hook 630 is part of the system according to the present 
invention, and is used to permit communication between the operating system and the system 
according to the present invention. Hook 630 listens for relevant events from the operating 
system. Hook 630 is capable of interpreting the event from the operating system, and of 
constructing the event in a message which is comprehensible to event 602. Hook 630 also 
dispatches the event to EventDispatcher 604, which communicates with each handler for the 
event, shown as EventHandler 506 (although there may be a plurality of such handlers). 
EventDispatcher 604 then reports to hook 630, which reports to operating system module 628 
about the handling of the event. 

Figures 7A-7C show exemplary events, and how they are handled by interactions 
between the mobile information device (through the operating system of the device) and the 
system of the present invention. It should be noted that some events may optionally be 
handled within the system of the present invention, without reference to the mobile 
information device. 

Figure 7A shows an exemplary key event sequence diagram, described according to a 
mobile information device that has the DMSS operating system infrastructure from 
Qualcomm Inc., for their MSM (messaging state machine) CDMA (code division multiple 
access) mobile platform. This operating system provides operating system services such as 
user interface service, I/O services and interactive input by using the telephone keys (keypad). 
This example shows how an input event from a key is generated and handled by the system of 
the present invention. Other events are sent to the system in almost an identical manner, 
although the function of hook 630 alters according to the operating system module which is 
sending the event; optionally and preferably, a plurality of such hooks is present, such that 
each hook has a different function with regard to interacting with the operating system. 

As shown in Figure 7A, a ui_do_event module 700 is a component of the operating 
system and is invoked periodically. When a key on the mobile device is pressed, the user 
interface (UI) structure which transfers information to ui_do_event module 700 contains the 
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value of the key. Hook 630 then receives the key value, optionally and preferably identifies 
the event as a key event (particularly if ui_do_event module 700 dispatches a global event) 
and generates a key event 702. Key event 702 is then dispatched to EventDispatcher 604. 
The event is then sent to an application 704 which has requested to receive notification of 
such an event, preferably through an event handler (not shown) as previously described. 
Notification of success (or failure) in handling the event is then preferably returned to 
EventDispatcher 604 and hence to hook 630 and ui_do_event module 700. 

Figure 7B shows a second illustrative example of a sequence diagram for handling an 
event; in this case, the event is passed from the system of the present invention to the 
operating system, and is related to drawing on the screen of the mobile information device. 
Information is passed through the screen access method of the operating system, in which the 
screen is (typically) represented by a frame buffer. The frame buffer is a memory segment 
that is copied by using the screen driver (driver for the screen hardware) and displayed by the 
screen. The system of the present invention produces the necessary information for 
controlling drawing on the screen to the operating system. 

Turning now to Figure 7B, as shown by arrow "1", the operating system (through 
scrn_update_main module 710) first updates the frame buffer for the screen. This updating 
may optionally involve drawing the background for example, which may be displayed on 
every part of the screen to which data is not drawn from the information provided by the 
system of the present invention. Optionally, the presence of such a background supports the 
use of semi-transparent windows, which may optionally and preferably be used for the 
creature or agent as described in greater detail below. 

Scrn_update_main module 710 then sends a request for updated data to a screen 
module 712, which is part of the system of the present invention and which features a hook 
for communicating with the operating system. Screen module 712 then sends a request to 
each application window, shown as an agentWindow 714, of which optionally a plurality may 
be present, for updated information about what should be drawn to the screen. If a change has 
occurred, such that an update is required, then agentWindow 714 notifies screen module 712 
that the update is required. Screen module 712 then asks for the location and size of the 
changed portion, preferably in two separate requests (shown as arrows 2.1.2.1 and 2.1.2.2 
respectively), for which answers are sent by agentWindow 714. 

Screen module 712 returns the information to the operating system through 
scrn_update_main 710 in the form of an updated rectangle, preferably as follows. 
Scrn_update_main 710 responds to the notification about the presence of an update by 
copying the frame buffer to a pre-buffer (process 3.1). Screen module 712 then draws the 
changes for each window into the pre-buffer, shown as arrow 3.2.1. The pre-buffer is then 
copied to the frame buffer and hence to the screen (arrow 3.3). 
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Figure 7C shows the class architecture for the system of the present invention for 
drawing on the screen. Screen module 712 and agentWindow 714 are both shown. The class 
agentWindow 714 also communicates with three other window classes, which provide 
information regarding updating (changes to) windows: BackScreenWindow 716, 
BufferedWindow 718 and DirectAccessWindow 720. BufferedWindow 718 has two further 
window classes with which it communicates: TransBufferedWindow 722 and 
PreBufferedWindow 724. 

Section 2: Action Selection System 

This Section describes a preferred embodiment of an action selection system 
according to the present invention, including but not limited to a description of optional action 
selection according to incentive(s)/disincentive(s), and so forth. In order to assist in 
explaining how the actions of the intelligent agent are selected, an initial explanation is 
provided with regard to the structure of the intelligent agent, and the interactions of the 
intelligent agent with the virtual environment which is preferably provided by the system of 
the present invention. 

Figure 8 describes an exemplary structure of the intelligent agent (Figure 8A) and 
also includes an exemplary sequence diagram for the operation of the intelligent agent (Figure 
8B). As shown with regard to Figure 8A, an intelligent agent 800 preferably includes a 
plurality of classes. The main class is AlCrearure 802, which includes information about the 
intelligent agent such as its state, personality, goals etc, and also information about the 
appearance of the creature which visually represents the agent, such as location, color, 
whether it is currently visible and so forth. 

AlCreature 802 communicates with World 804, which is the base class for the virtual 
environment for the intelligent agent. World 804 in turn communicates with the classes which 
comprise the virtual environment, of which some non-limiting examples are shown. World 
804 preferably communicates with various instances of a WorldObject 806, which represents 
an object that is found in the virtual environment and with which the intelligent agent may 
interact. World 804 manages these different objects and also receives information about their 
characteristics, including their properties such as location and so forth. World 804 also 
manages the properties of the virtual environment itself, such as size, visibility and so forth. 
The visual representation of WorldObject 806 may optionally use two dimensional or three 
dimensional graphics, or a mixture thereof, and may also optionally use other capabilities of 
the mobile information device, such as sound production and so forth. 

WorldObject 806 itself may optionally represent an object which belongs to one of 
several classes. This abstraction enables different object classes to be added to or removed 
from the virtual environment. For example, the object may optionally be a "ball" which for 
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example may start as part of a menu and then be "removed" by the creature in order to play 
with it, as represented by a MenuBallObject 808. A GoodAnimalObject 810 preferably also 
communicates with WorldObject 806; in turn, classes such as FoodObject 812 (representing 
food for the creature), BadAnimalObject 814 (an animal which may annoy the creature and 
cause them to fight for example) and HouseObject 816 (a house for the creature) preferably 
communicate with GoodAnimalObject 810. GoodAnimalObject 810 includes the 
functionality to be able to draw objects on the screen and so forth, which is why other classes 
and objects preferably communicate with GoodAnimalObject 810. Of course, many other 
classes and objects are possible in this system, since other toys may optionally be provided to 
the creature, for example. 

WorldObject 806 may also optionally and preferably relate to the state of the 
intelligent agent, for example by providing a graded input to the state. This input is 
preferably graded in the sense that it provides an incentive to the intelligent agent or a 
disincentive to the intelligent agent; optionally it may also have a neutral influence. The 
aggregation of a plurality of such graded inputs preferably enables the state of the intelligent 
agent to be determined. As described with regard to the sequence diagram of Figure 8B, and 
also the graph search strategy and action selection strategy diagrams of Figures 9A and 9B 
respectively, the graded inputs are preferably aggregated in order to maximize the reward 
returned to the intelligent agent from the virtual environment. 

These graded inputs may also optionally include input from the user in the form of 
encouraging or discouraging feedback, so that the intelligent agent has an incentive or 
disincentive, respectively, to continue the behavior for which feedback has been provided. 
The calculation of the world state with respect to feedback from the user is optionally and 
preferably performed as follows: 

Grade = ( weight in g_factor * feedbackjeward) + ((l-weighting_factor) * 
world_reward), in which the feedback_reward results from the feedback provided by the user 
and the world_reward is the aggregated total reward from the virtual environment as 
described above; weighting_factor is optionally and preferably a value between 0 and 1, 
which indicates the weight of the user feedback as opposed to the virtual environment (world) 
feedback. 

Non-limiting examples of such reward for the agent's action include positive or 
negative feedback on die agent's suggestion; provision of a world object such as a ball or food 
to the agent; telephone usage duration: user teaching duration; and the like. Each of these 
examples can be assigned a predetermined score, and the agent's action can be restricted or 
expanded according to a corresponding accumulated score. For example, positive and 
negative feedback provided bv the user may be assigned positive and negative point values, 
respectively; encountering an enemy or bad animal: -20 points; obtaining a food, toy or house 
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object: ±5 points; low battery alarm: -1 point: correct and incorrect answers, when the agent 
teaches the user: +1 point and -1 point, respectively: inactivity for 20 minutes: -1 point; 
wrong dialing: -1 point; SMS use: +1 point: and the like. The above examples may be 
applied in other ways. 

Figure 8B shows an illustrative sequence diagram for an exemplary set of interactions 
between the virtual world and the intelligent agent of the present invention. The sequence 
starts with a request from a virtual world module 818 to AlCreature 802 for an update on the 
status of the intelligent agent. Virtual world module 818 controls and manages the entire 
virtual environment, including the intelligent agent itself. 

The intelligent agent then considers an action to perform, as shown by arrow 1.1.1. 
The action is preferably selected through a search (arrow 1.1.1.1) through all world objects, 
and then recursively through all actions for each object, by interacting with World 804 and 
WorldObject 806. The potential reward for each action is evaluated (arrow 1.1.1.1.1.1) and 
graded (arrow 1.1.1.1.1.1.2). The action with the highest reward is selected. The overall 
grade for the intelligent agent is then determined and AlCreature 802 performs the selected 
action. 

Virtual_world 818 then updates the location and status of all objects in the world, by 
communicating with World 804 and WorldObject 806. 

The search through various potential actions may optionally be performed according 
to one or more of a number of different methods. Figures 9A and 9B show two exemplary 
methods for selecting an action according to the present invention. 

Figure 9A shows an exemplary method for action selection, termed herein a rule 
based strategy for selecting an action. In stage 1, the status of the virtual environment is 
determined by the World state. A World Event occurs, after which the State Handler which is 
appropriate for that event is invoked in stage 2. The State Handler preferably queries a 
knowledge base in stage 3. Optionally, the knowledge base may be divided into separate 
sections and/or separate knowledge bases according to the State Handler which has been 
invoked. In stage 4, a response is returned to the State Handler. 

In stage 5, rule base validation is performed, in which the response (and hence the 
suggested action which in turn brings the intelligent agent into a specific state) is compared 
against the rules. If the action is not valid, then the process returns to stage 1. If the action is 
valid, then in stage 6 the action is generated. The priority for the action (described in greater 
detail below with regard to Figure 9C) is then preferably determined in stage 7; more 
preferably, the priority is determined according to a plurality of inputs, including but not 
limited to, an action probability, an action utility and a user preference. In stage 8, the action 
is placed in a queue for the action manager. In stage 9, the action manager retrieves the 
highest priority action, which is then performed by the intelligent agent in stage 10. 
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Figure 9B shows an exemplary action selection method according to a graph search 
strategy. Again, in stage 1 the process begins by determining the state of the world (virtual 
environment), including the state of the intelligent agent and of the objects in the world. In 
stage 2, the intelligent agent is queried. In stage 3, the intelligent agent obtains a set of legal 
(permitted or possible) actions for each world object; preferably each world object is queried 
as shown. 

The method now branches into two parts. A first part, shown on the right, is 
performed for each action path. In stage 4, an action to be performed is simulated. In stage 5, 
the effect of the simulation is determined for the world, and is preferably determined for each 
world object in stage 6. In stage 7, a grade is determined for the effect of each action. 

In stage 8, the state of the objects and hence of the world is determined, as is the 
overall accumulated reward of an action. In stage 9, the effect of the action is simulated on 
the intelligent agent; preferably the effect between the intelligent agent and each world object 
is also considered in stage 10. 

Turning now to the left branch of the method, in stage 11, all of this information is 
preferably used to determine the action path with the highest reward. In stage 12, the action is 
generated. In stage 13, the action priority is set, preferably according to the action grade or 
reward. In stage 14, the action is placed in a queue at the action manager, as for Figure 9 A. 
In stage 15, the action is considered by the action manager according to priority; the highest 
priority action is selected, and is preferably executed in stage 16. 

N e xt, a d e scription is provid e d of an e x e mplary action e x e cution m e thod and 
structure. Figure 10 shows a sequence diagram of an exemplary action execution method 
according to the present invention. A handler 1000 send a goal for an action to an action 
m od u le 10 0 2 in arrow 1, which preferably features a base action interface. "Hie ba s e action 
interfaee-enables-a^t^ with o ther 

obj e cts in th e system, which ar e abl e to g e n e rate an d post a c tio ns for lat e r e x e cution by th e 
intelligent agent shown her e as a Floating Ag e ntApp 1006. Th es e actions ar e managed by an 
action manager 100 4 . 

Action manager 1004 has two queues containing action objects. One queue is the 
ready for execution queue, while the other qu e ue is the pending for e xecution queue. The 
latt e r queue may be used for example if an action has been generated, but the internal state of 
th e action is p e nding so that th e action is not ready for ex e cut i on. — When the action stat e 
matures to be ready for e x e cution, th e action is preferably moved to the ready for e x e cution 
queu e . 

An application manager 100 8 preferably interact s with FloatingAgentApp 1006 for 
executing an action, as shown in arrow 2. — FloatingAgentApp 1006 then preferably requests 
th e next action from action manag e r 1 -0 0 4 (arrow 2.1); the action itself is preferably provided 
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by action modul e 1002 (arrow 2.2.1). Actions ar e preferably e nqu e u e d from handl e r 1000 to 
action manager 1001 (arrow 3). Goals (and hence at l e ast a pan of th e priority) are preferably 
Get for each action by communication betwe e n handl e r 1000 and action modul e 1002 (arrow 
4). Arrows 5 and 6 show- th e harakiri Q method, described in greater detail below. 

As pr e viously describ e d, the actions ar e pref e rably queued in priority ord e r: — The 
priority is pr e f e rably d e t e rmin e d through querying th e interfac e of action modul o 1002 by 
action manag e r 100 4 . — Th e priority of th e action is preferably det e rmin e d according to a 
calculation which includes a plurality of parameters. For example, the param e ters preferably 
include the priority a s derived or inferred by th e g e n e rating object, more preferably based 
upon the predicted probability for the sucocss of the action; the persistent priority for this typ e 
o f act i on, whi c h pre ferably i s d e t e rmin e d according to past experience with this type of action 
(for example according to user acceptance and action success); and the goal priority, which is 
preferab l y de t e m iined^eeofding4o4he- us e r pr efereneesr 

On e optional calculation for managing th e abov e param e t e rs is as follows: 
P(all) ~ P(action probability) * ((P(persistcnt priority) + P(action goal)/10))/2) 
Complem e ntary for the priority based action execution, each action refcrably has a 
Tim e To Liv e (ttl) period: this ttl value stands for the amount of execu t ion time pass e d 
between th e action was post e d in th e r e ady queue and th e expiration time of this action. If on 

fTOttager-4004 pr e f e rably i nvok e s th e m ethed-ha rakiri Q, whi ch-aotifies t h e action that it will 
n ot be e x e cut e d. Each such invocation o f har afeiQ-fr r e ferably d e cr e a se s th e priority of th e 
action until a threshold is reached. After this thr es hold has been reached, the persistent 
priority preferably starts to incr e ase. This model operates to handl e actions that were 
proposed or ex e cuted but fail e d since th e user abort e d the action. The persistent priority 
de€*ease$4>y4neerperafeg4he^ 

Thi s m e thod shows how actions that were sugg e st e d or executed adapt to th e s p e cific 
user's implicit pr e f e r e nces in runtim e : 

This model is not complete without the harakiri() mechanism since if an action 
p e r s i s tent priority reduces, so the action does not run, it n e ed s to be allow e d to either b e 
remov e d or else possibly run again, for example if the user preferences change. After several 
e x e cutions of harakiriQ, the action may regain the priority to run. 

The pr e vious Sections provid e infrastructur e , which e nabl e s various actions and 
mechanisms to be performed through the adaptive system of the present invention. These 
actions and m e chanisms are described in greater detail below. 

Section 3: Emotional System 
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Thio Section d e scribes a pref e rred embodiment of on e motional syst e m according to 
the pr e sent inv e ntion, including but not limit e d to a d e scription of specific e motions and th e ir 
intensity, which pref e rably combin e to form an overall mood. — The emotional s yst e m 
pr e f e rably also includ e s a m e chanism for allowing moods to change as svell as for optionally 
controll i ng one or mor e asp e ct s of s uch a chang e , such as t h e rate of c hange for exa mpl e . 

Figur e s — 11A 11C featur e diagrams for d e scribing an exemplary, illustrativ e 
implem e ntation of an e motional syst e m according to th e pr e s e nt inv e ntion, — Figure 11A 
shows an e xemplary class diagram for the e motional system, while Figures 11B and 1 1C 
s how exemplary sequence diagrams for operation of the emotional system according to the 
present invention. 

As shown with regard to an e motional syst e m 14-0 0 according to th e pres e nt 
invention, the goal class (goal 1102 ) represe n ts an abstract goal of th e intelligent agent. A 
geaHs^emertttng^hkh^he^nte^ 

respon s ibl e for cr e ating emotion s bas e d on certain e v e nts that are r e lat e d to th e state of th e 
goal and its chanc e s of fulfillment. 

Goal 1102 interacts with AlCrearure 8 02 (also previously described with regard to 
F i gure 8). Thes e interactions are described in gr e at e r d e tail below. Briefly, th e int e lligent 
agent seeks to fulfill goals, so the int e ractions between AlCrearure 802 are required in order 

th e int e lligent ag e nt. 

The e m ot i o na l s tate it s elf i 
is connected to the class Emotion 1106. — Emotion 1106 is itself preferably connect e d to 
classes for s pecific e motion s such as the ang e r class AngerEmotion 1108 and the joy class 

determin es th e pa #eri^f%ehav4ei~Be 

The-ere a ti on o f emo tio n i s pr e f e rably pe rform e d through the e motional syst e m wh e n 
th e lik e lihood of success (LOS) increas e s or d e cr e as e s and wh e n th e likelihood to fail (LOF) 
increases or decreases. When LOS increases, then the hope emotion is preferably generat e d. 
When LOS d e crea s es, the despair e motion is preferably generated. When LOF increases, th e 
fear emotion is preferably generated, and when LOF decreases, then the joy emotion i s 
pr e f e rably generat e d. 

Success or failure of a goal ha s a s ignificant e ffect on the goal state and generated 
e motion s . Wh e n a goal fails, despair is pr e ferably generat e d, and if th e lik e lihood of succ ess 
was high, frustration is also preferably generated (since expectation of success was high). 

When a goal succeeds, joy is preferably g e nerated, and if expectation and 
accumulated success were high, then pride is preferably generat e d. 
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Emotion 1 106 i s a s tructure that has two prop e rties, which ar e major and minor typ es . 
Th e major typ e describes the high lev e l group to which th e minor e motion b e longs, pr e ferably 
including POSITIVE JIMOT.TON and NEGATIVE J5MOTION. — Minor typ e s preferably 
includ e JOY, HOPE, GLOAT, PRIDE, LIKE. ANGER, HATE, FEAR, FRUSTRATION, 
DISTRESS, DISAPPOINTMENT. Other p ro p e rti e s o f the emotion are the int e n s ity given 
when g e n e rated, and the d e cay policy (ie th e rate of change of th e emotion). 

Th e next phase aft e r e motion g e neration is p e rformed by th e EmotionalSiate class 
110 4 that accumulates emotions which were generated ov e r time by the intelligent agent. This 
class r e presents the collection of emotion instanc e s that defines th e current emotional state of 
the intelligent agent. The current emotional state is preferably defined by maintaining a 
hi e rarchy of e motion typ es , which are th e n g e neralized by aggr e gation and corr e lation. For 
example. — the — minor — e motion s — are — pr e ferably — aggr e gat e d — mte — a — scor e — for 
PQSITIVE _ EM OTl ; QN--aiKl-^-seore for N EG ATIV E EM OTION; these tw o -gategories-aFe 
th e n pr e ferably corr e lat e d to GOOD/BAD MOOD, which d e scrib e s t he ov e rall mood of th e 
intelligent agent. 

The EmotionalState class 110 4 is queried by the intelligent agent floating application; 
whene v e r the domin a nt behavior patt e rn changes (by em o ti o n s generated, d e cay e d and 
g e n eralize d in the previously de s crib e d model), th e intelligent agent preferably expresses it s 
aHetionaI--^ ; tate-aftd--behave5 according to that b ehav i or al p a tt e rn. Th e intel lige nt ag e nt 
optionally and prefera b ly e xpr e ss e s its e motional stat e using on e or mor e of the text 
co mmu nicati o n e ng ine (de sc ri b e d in gr e at e r d e ta il b elow ) , thre e dim ension al animation, facial 
expr e ssions, two dimen s ional animated effects and sounds. 

Figure 1 IB shows an ex e mp l ary sequence diagram for gen e ration of an e motion by 
the emotional system according to the pres e nt invention. As shown, application manager 5 03 
(deser&ed4ri~gFeatef^ 

(d e scr i bed in gr e at e r d e tail with regard to Figur e 10) in arrow 1. FloatingAg c ntApp 100 6 
th e n d e t e rmines the LOF (likelihood of failur e ) by qu e rying the goal olass 1102 in arrow LI. 
Goal 1102 th e n determines the LOF; if the new LOF is greater than the previously determin e d 
LOF, fear i s preferably generated by a request to e motion c l ass 1.106 in arrow 1.1.1.1. The 
fear emotion is also added to the emotional state by communication with EmotionalStat e 110 4 
in arrow LI. 1.2. 

N e xt application manager 502 s e nds anoth e r step (arrow 2) to FloatingAgcntApp 
1006, which determin e s th e LOS (lik e lihood of s uccess) by again querying Goal 1102 in 
arrow 2.1. Goal 1102 th e n d e termines the LOS; if the new LOS is gr e at e r than the previously 
determined LOS, hop e is preferably generated by a request to emotion class 1106 in arrow 
2.1.1.1. — The hope emotion is also add e d to the emotional s tate by communication with 
EmotionalStat e 110 4 in arrow 2.LL2. 
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Arrow 3 shows application manager 502 sending anoth e r s t e p to FloatingAg e ntApp 
1006, which r e quests d e termination of emotion according to th e actual outcom e of an action. 
If the action has failed and the la s t LOS was greater than some factor, s uch as 0.5, which 
indicated that succe s s was expected, then FloatingAgentApp 1 004 5 causes Goal 1102 to have 
de s p ai r g e nerated by Em etie n 11 06 in arr ow 3 .1.1.1, The despair emotion is al s o added to th e 
emotional stat e by communication with EmotionalStat e 110 4 in arrow 3.1.1.2. Also, if the 
action failed (preferably r e gardl es s of th e e xpectation of success), distr e ss is pr e f e rably 
generated by Emotion 1106 in arrow 3.1.2. Th e di s tress emotion is also add e d to the 
e motional state by communication with EmotionalState 1104 in arrow 3.1.3. 

Next, application manag e r 502 sends another step (arrow 4 ) to FloatingAgentApp 



1402-Hft 



arrow 4 .1. Goal 1102 then pref e rably caus e s joy to preferably be g e nerated by a requ e st to 

commun ication with Emotion alSta t e 110 4 in arrow 4 .1.2. 

If actual success is greater than predicted, then Goal 1102 preferably causes pride to 



add e d to t he e m otion al state by communication with EmotionalStat e 1404 in arrow 4 .1.3.2. 

Figure 1 1C shows an ex e mplary sequence diagram for expressing an emotion by th e 

by th e us e r p r e fer e nces. Application manag e r 502 initiat e s e motional e xpr e ssion by s e nding a 

b e havioral pattern of the intelligent ag e nt in arrow 1.1. If the dominant behavior has changed, 
then FloatingAg e ntApp 10 06 sends a requ e st to bp_display 1110 to set the behavioral pattern 
(arrow 1.2.1). — Bp_display 1 44 0 controls the actual display of emotion. FloatingAg e ntApp 
l#06^ht3n-req^esB^f^^ 

Application manag e r 502 s e nds anoth e r step (arrow 2) to FloatingAg e ntApp 1006, 
which requ e sts that the action be r e mov e d from the queue (arrow 2.1) to action manager 
rHH M;, and that the action be performed by bp ^display 11 I rOr 



Section 34: Communication with the User 

This Section describes a preferred embodiment of a communication system for 
communication with the user according to the present invention, including but not limited to 
textual communication, audio communication and graphical communication. For the purpose 
of description only and without any intention of being limiting, textual communication is 
described as an example of these types of communication. 



37 



678-1264 (PI 1404) 



Figure 105 shows an exemplary sequence diagram for textual communication 
according to the present invention. A text engine 1200 is responsible for generating text that 
is relevant to a certain event and which can be communicated by the intelligent agent. Text 
engine 1200 preferably includes a natural language generation of sentences or short phrases 
according to templates that are predefined and contain place holders for fillers. Combining the 
templates and the fillers together enable text engine 1200 to generate a large number of 
phrases, which are relevant to the event to which the template belongs. 

This framework is optionally extensible for many new and/or changing events or 
subjects because additional templates can also be added, as can additional fillers. 

As shown in Figure 120, FloatingAgentApp 1006 communicates with text engine 
1200 by first sending a request to generate text, preferably for a particular event (arrow 1). 
Text engine 1200 preferably selects a template, preferably from a plurality of templates that 
are suitable for this event (arrow 1.1). Text engine 1200 also preferably selects a filler for the 
template, preferably from a plurality of fillers that are suitable for this event (arrow 1.2.1). 
The filled template is then returned to FloatingAgentApp 1006. 

The following provides an example of generation of text for a mood change event, 
which is that the intelligent agent is now happy, with some exemplary, non-limiting templates 
and fillers. The templates are optionally as follows: 

Happy template 1: "%nounl is %happy_adj2" 

Happy template 2: "%self_f_pronoun %happy_adj 1 " 

The fillers are optionally as follows: 

%nounl - {"the world", "everything", "life", "this day", "the spirit"} 
%happy_adjl = {"happy", "joyful", "glad", "pleased", "cheerful", "in high spirits", 
"blissful", "exultant", "delighted", "cheery", "jovial", "on cloud nine" } 

%happy_adj2 = {"nice", "beautiful", "great", "happy", "joyful", "good", "fun"} 
%self_fj)ronoun = {"I am", Tm", "your intelligent agent", "your agent friend"} 

Examples of some resultant text communication phrases from combinations of 
templates and fillers: 
I'm cheerful 
the spirit is joyful 
I am exultant 
life is beautiful 
life is good 
I'm pleased 
I'm jovial 
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I am joyful 

the world is joyful 

I'm glad 

the spirit is joyful 
the spirit is happy 
the world is nice 
I am happy 

As another non-limiting example, a missed call template could optionally be 
constructed as follows: 

%user missed a call from %missed %reaction 

In this example, the user's name is used for %user; the name or other identifier (such 
as telephone number for example) is entered to %missed; %reaction is optional and is used 
for the reaction of the intelligent agent, such as expressing disappointment for example (e.g. 
"I'm sad"). 

As shown by these examples, text engine 1200 can generate relevant sentences for 
many events, from missed call events to low battery events, making the user's interaction 
with the mobile information device richer and more understandable. 

Section 4£: Adaptive System for Telephone Calls and SMS Messages 

This Section describes a preferred embodiment of an adaptive system for adaptive 
handling of telephone calls and SMS messages according to the present invention. This 
description starts with a general description of some preferred algorithms for operating with 
the system according to the present invention, and then describes the telephone call handling 
and SMS message handling class and sequence diagrams. 
Smart Alternative Number (SAN) 

The SAN algorithm is designed to learn the alternative number most likely to be 
dialed after a call attempt has failed. The algorithm learns to create these pairs and then is 
able to dynamically adapt to new user behavior. These associated pairs are used to suggest a 
number to be called after a call attempt by the user has failed. 

This algorithm may optionally be implemented as follows: Insert most frequently 
used items to the first layer (optionally insertions occur after the item frequency is bigger than 
a predefined threshold); Suggest associated pair to a phone number, preferably according to 
frequency of the pair on the list; Determine call success or failure; and Hold a window of the 
history of determined pairs per number, such that the oldest may optionally be deleted. 



39 



678-1264 (PI 1404) 

The knowledge base for this algorithm may optionally be represented as a forest for 
each outgoing number, containing a list of alternative / following phone calls and/or other 
actions to be taken. For each outgoing call, the next call is preferably considered as following, 
if the first call fails and the second call was performed within a predefined time-period. The 
following call telephone number is added to the list of such following call numbers for the 
first telephone number. When the list is full, the oldest telephone number is preferably 
forgotten. 

Smart Phonebook Manager (SPBM) 

The SPBM system is a non-limiting example of an intelligent phonebook system that 
uses mobile information device usage statistics and call statistics to learn possible contacts 
relations and mutual properties. This system provides several new phonebook features 
including but not limited to automated contact group creation and automated contact 
addition/removal. 

For example, an automated group management algorithm is preferably capable of 
automatically grouping contact telephone numbers according to the usage of the user. 

Automated State Detection (ASD) 

The ASD system preferably enables the mobile information device to determine the 
user current usage state (e.g. Meeting, User away) and to suggest changes to the UI, sound 
and the AI behavior systems to suit the current state (e.g. activate silent mode for incoming 
telephone calls and/or send an automated SMS reply "In meeting"). Optionally and 
preferably, this system is in communication with one or more biological sensors, which may 
optionally and preferably sense the biological state of the user, and/or sense movement of the 
user, etc. These additional sensors preferably provide information which enables the adaptive 
system to determine the correct state for the mobile information device, without receiving 
specific input from the user and/or querying the user about the user's current state. Images 
captured by a device camera could also optionally be used for this purpose. 

Another optional type of sensor would enable the device to identify a particular user, 
for example through fingerprint analysis and/or other types of biometric information. Such 
information could also optionally be used for security reasons. 

The meeting mode advisor algorithm is designed to help the user manage the do-not- 
disturb mode. The algorithm has a rule base that indicates the probability that the user is in a 
meeting mode and does not want to be disturbed, as opposed to the probability that the user 
has not changed the mode but is ready to receive calls. The algorithm's purpose is to help 
manage these transitions. 
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The algorithm preferably operates through AI state handlers, as previously described, 
by determining the phone world state and also determining when the rule base indicates that 
meeting mode should be suggested (e.g. user stopped current call ring and didn't answer the 
call ..etc'). The StateHandlers also preferably listen to the opposite type of events which may 
indicate that meeting mode should be canceled. 

Figures 1J3A and lJ^B show an exemplary class diagram and an exemplary 
sequence diagram, respectively, for telephone call handling according to the present 
invention. 

As shown with regard to Figure U3A, a telephone call handling class diagram 1300 
features a CallStateHandler 1302, which is responsible for the generation of SuggestCall 
actions by SuggestCall class 1304. CallStateHandler 1302 is preferably a rule based algorithm 
that listens to call events such as CallStartedEvent 1306, CallEndedEvent 1308 and 
CallFailedEvent 1310; each of these events in turn communicates with a CallEvent 1312 
class. CallStateHandler 1302 also preferably maintains a rule base that is responsible for two 
major functions: Machine Learning, which maintains the call associations knowledge base; 
and the AI probability based inference of whether to suggest a number for a telephone call to 
the user (these suggestions are preferably handled through SuggestFollowingCall 1314 or 
SuggestAlternativeCall 1316). 

The call event objects are generated using the event model as previously described, 
again with a hook function in the operating system of the mobile information device. The call 
data is preferably filled if possible with information regarding the generated event (telephone 
number, contact name, start time, duration, etc'). 

The suggest call classes (reference numbers 1304, 1314 and 1316) implement the 
base action interface described in the adaptive action model. The responsibility of these 
classes is to suggest to the user a telephone number for placing a following call after a 
telephone call has ended, or for an alternative telephone call after a telephone call has failed. 

CallStateHandler 1302 listens to call events and classifies the event according to its 
rule base (action selection using a rule base strategy). An example of an illustrative, optional 
call suggestion rule base is given as follows: 

1. if a telephone call started and no prior telephone call marked -> mark call as 

started 

2. if the telephone call ended and call was marked as started -> mark as first 
telephone call 

3. if a telephone call started and the prior telephone call was marked as first call and 
the time between calls < following call threshold -> mark as following call 

4. if marked call as following -> update knowledge base 
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5. if marked call as following -> mark call as first call (this resets the current first 
telephone call for comparison to the next telephone call) 

6. if call failed and prior call marked as call started -> mark call as first failed 

7. if call started and prior call marked as first failed and time between calls < failed 
call threshold -> mark as alternative call 

8. if marked as alternative call -> update knowledge base 

9. if call ended and time since end call < suggest following call threshold and 
inferred following call -> generate suggested following telephone call action (e.g. an action to 
be taken after the telephone call) 

10. if call failed and time since failed call < suggested alternative call threshold and 
inferred following call -> generate suggested alternative telephone call action 

1 1 . if time from last mark > threshold -> unmark all calls 

The call suggestion knowledge base is optionally and preferably designed as a history 
window, in which associations are added as occurrences in the history of the subject. In this 
case, the associated subject for an alternative or following telephone call for a certain contact 
is the contact itself, and all associated calls are preferably located by occurrence order in the 
alternative telephone call or following telephone call history window. 

For example for the contact telephone number 054-545191, the call associations in 
the history window may optionally be provided as follows: 



054-545191 -> 



052- 


052- 


051- 


052- 


051- 


052- 


051- 


051- 


052- 


052- 


552211 


552212 


546213 


552211 


546213 


552211 


897555 


897555 


552211 


552211 



The history window size is preferably defined by the algorithm as the number of 
assocations (occurrences) which the algorithm is to manage (or remember). If the history 
window is full, the new occurrence is preferably added in the front and the last one is then 
removed, so that the window does not exceed its defined size. This knowledge base is able to 
adapt to changes in the user patterns since old associations are removed (forgetten) in favor of 
more up to date associations. 

The knowledge base is not enough to suggest alternative or following calls, as a good 
suggestion needs to be inferred from the knowledge base. The inference algorithm is 
preferably a simple probability based inference, for determining the most probable association 
target according to the knowledge base. Given the following parameters: 

C 0 - contact 

Ho(Ci) - the number of times contact Q can be found in C 0 history window 
Hsize - history window size 

The method preferably suggests contact i such that: 
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P(Q) = Max( H 0 (CO/H size ) 

In the example above for C 0 = 054-545191: 
P(052-55221 1) is maximal and = 0.6 

The inference process is considered to be successful only if it can infer a probability 
that is more than %50 and preferably also if the history window is full. 

Figure 1 1£B shows an exemplary sequence diagram for telephone call handling. As 
shown, EventDispatcher 604 (described in greater detail in Figure 6) sends a notification of a 
call event to CallStateHandler 1302 (arrow 1), which then evaluates the rule base (arrow 1.1). 
A request to add an association to HistoryWindow 1318 is made (arrow 1.1.1). 

For a call ended or failed event, EventDispatcher 604 sends a notification to 
CallStateHandler 1302 (arrow 2), which then evaluates the rule base (arrow 2.1). A request to 
add an association to HistoryWindow 1318 is made (arrow 2.1.1). A request to receive a 
probable association from HistoryWindow 1318 is made (arrow 2.2). This probable 
association represents a telephone number to call, for example, and is sent from 
CallStateHandler 1302 to SuggestCall 1304 (arrow 2.3). The action is enqueued by action 
manager 1008 (arrow 2.4). 

Another optional but preferred algorithm helps the user to manage missed calls and 
the call waiting function. This algorithm targets identifying important calls that were missed 
(possibly during call waiting) and suggests intelligent callback. This callback is suggested 
only to numbers that were identified by the user (or the knowledge base) as important. 

The knowledge base is based on two possible (complementary) options. The first 
option is explicit, in which the user indicates importance of the call after it has been 
performed and other information in extended address book field. The second implicit option 
is given by frequency of the call and other parameters. 

The algorithm may suggest a callback if the callback number is important and the 
user did not place the call for a period of time and/or the target number has not placed an 
incoming call. 

Content-based SMS Addressee Inference (CSA1) 

The CSAI algorithm is designed to optionally and preferably predict a message 
addressee by the content of the message. This algorithm preferably learns to identify certain 
word patterns in the message and to associate them to an existing address book contact. This 
contact is suggested as the message destination upon message completion. 
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This algorithm may optionally operate according to one or more rules, which are then 
interpreted by a rule interpreter. The adaptive system (for example, through learning module) 
would preferably learn a table of (for example) 1000 words. Each new word appearing in an 
outgoing SMS message is added to the list. For each word there is an entry for each SMS 
contact (i.e. contacts for which at least one SMS message was sent). Each word/contact entry 
contains the number of times that the word appeared in SMS messages to this contact, 
preferably with the number of SMS messages sent to each contact. 

In order for the inference mechanism to work, preferably for each word W in the 
current SMS message and for each contact C, the probability that P(C|W) is calculated, based 
on P(W|C) given in the table and P(C) also computed from the table. Then the number of 
terms normalized by the number of words in the current SMS message is added. 

The SMS handling method is targeted at analyzing the SMS message content and 
inferring the "send to" address. The algorithm optionally and preferably uses the following 
heuristics, with specific indicating words that reappear when sending a message to a specific 
addressee. 

Each new word appearing in an outgoing SMS message is added to the list. For each 
word there is an entry for each SMS contact (i.e. contacts for which at least one SMS was 
sent). Each word/contact entry contains the number of times that the word appeared in SMS 
to this contact. Also, preferably the number of SMS sent to each contact is stored. Learning 
preferably occurs by updating the word table after parsing newly sent SMS messages. 

The AI inference method preferably operates with simple probability as previously 
described. 

Figures 124 A and 124B describe illustrative, non-limiting examples of the SMS 
message handling class and sequence diagrams, respectively, according to the present 
invention. 

Figure 124A shows an exemplary SMS message handling class diagram 1400 
according to the present invention. A SMSstateHandler 1402 class and a SuggestSMStoSend 
1404 class are shown. SMSstateHandler 1402 is responsible for receiving information about 
the state of sending an SMS; SuggestSMStoSend 1404 is then contacted to suggest the 
address (telephone number) to which the SMS should be sent. 

Figure 124B shows an exemplary sequence diagram for performing such a 
suggestion. EventDispatcher 604 (see Figure 6 for a more detailed explanation) sends a 
notification to SMSstateHandler 1402 about an SMS event (arrow 1). SMSstateHandler 1402 
starts by parsing the knowledge base (arrow 1.1.1); a request is then sent to SMSdata 1406 for 
information about contacts (arrow 1.1.1.1). The SMS is preferably tokenized (e.g. parsed) in 
arrow 1.1.1.2, and a suggested contact address is requested from SMSdata 1406 (arrow 
1.1.1.3). 
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If a suggested contact address is obtained, SMSstateHandler 1402 preferably 
generates an action, which is sent to SuggestSMStoSend 1404 (arrow 1.1.2.1.1), followed by 
setting a goal for this action (arrow 1.1.2.1.2) and enqueueing the action (arrow 1.1.2.1.3) by 
sending to action manager 1008 (see Figur e 10 for a mor e d e tailed explanation) . 

Once the SMS has been sent, notification is sent from EventDispatcher 604 to 
SMSstateHandler 1402 (arrow 2), which handles this state (arrow 2.1), preferably including 
updating the knowledge base (arrow 2.1.1) and inserting the new SMS data therein (arrow 
2.1.1.1, in communication with SMSdata 1406). 

Section 56: Adaptive System for Menus 

This Section describes a preferred embodiment of an adaptive system for adaptive 
handling of menus according to the present invention. A general description of an algorithm 
for constructing, arranging and rearranging menus is first described, followed by a description 
of an exemplary menu handling class diagram (Figure 15). 

The adaptive menu system is based on the ability to customize the menu system or 
the human user interface provided with the operating system of the mobile information device 
by using automatic inference. All operating systems with a graphical user interface have a 
menu, window or equivalent user interface system. Many of the operating systems have an 
option to manually or administratively customize the menu system or window system for the 
specific user. The system described provides the possibility to automatically customize the 
user interface. Automatic actions are generated by the described system (possibly with user 
approval or automatically). The system uses the menu system framework and provides 
abstractions needed and the knowledge base needed in order to infer the right customization 
action and to provide the ability to automatically use the customization options provided with 
the operating system. 

Intelligent Menu assembler (IMA) 

The IMA algorithm is designed to dynamically create UI (user interface) menus 
based on the specific user preferences and mobile information device usage. The algorithm 
preferably identifies the telephone usage characteristics and builds a special personal menu 
based on those characteristics. 

This algorithm may in turn optionally feature two other algorithms for constructing 
the menu. The automatic menu shortcut menu algorithm is targeted at generating automatic 
shortcuts to favorite and most frequently used applications and sub applications. This 
algorithm focuses on improving the manual manner that was not used by most of the users to 
set up their personal shortcut menu. For the Knowledge Base and Learning, the 
PhoneWorldMapper accumulates executions of applications and sub applications and uses 
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that knowledge to infer which application / sub-application should be get a menu shortcut in 
the personal menu option and set it up for the user. 

The shortcut reasoning is based on the following utility function: the frequency of 
used application weighted by the amount of clicks needed saved by the shortcut (clicks in 
regular menu - (minus) the clicks in the shortcut). The highest utility application/sub- 
application/screen provides the suggestion and shortcut composition to the user. 

Another such menu algorithm may optionally include the automatic menu 
reorganizing algorithm. This algorithm is targeted at the lack of personalization in the menu 
system. Many users differ in the way they use the phone user interface but they have the same 
menu system and interface. This algorithm learns the user specific usage and reorganize the 
menu system accordingly, more preferably providing a complete adaptive menu system. 

For the knowledge base, the PhoneWorldMapper accumulates executions of 
applications and sub applications, as well as saving the number of clicks to the specific target. 
The phone world mapper will give a hierarchical view that is used when adding items to the 
same menu. Inside a menu the items are organized by their utility. 

Periodically, the menu system is preferably evaluated whether it is optimal to the user 
(by the parameters defined above), optionally followed by reorganization according to the 
best option inferred. 

Figure 13$ shows an adaptive menu system class diagram 1500. This class diagram 
provides the necessary abstraction through a PhoneWorldMapper 1502 class and a 
PhoneWorldNode 1504 class. PhoneWorldMapper 1502 is responsible to map the menu and 
user interface system. This mapping is done with PhoneWorldNode 1504. PhoneWorldNode 
1504 represents a menu, a submenu or a menu item in a graph structure. 

PhoneWorldMapper 1502 preferably contains a graph of PhoneWorldNode 1504 
objects; the edges are menu transitions between the nodes and the vertices are the mapped 
menus and items. Whenever the user navigates in the menu system, PhoneWorldMapper 1502 
follows through the objects graph of PhoneWorldNode 1504 objects, and points it to the 
correct location of the user. Whenever the user activates a certain item, the current node 
preferably records this action and count activations. PhoneWorldMapper 1502 also provides 
the present invention with the ability to calculate distance (in clicks) between each menu item 
and also its distance from the root, which is possible because of the graph representation of 
the menu system. Thus, Phone WordMapper 1502 provides abstraction to the menu structure, 
menu navigation, menu activation and distance between items in the menu. 

Class diagram 1500 also preferably includes a MenuEvent class 1506 for handling 
menu events and a SuggestShortcut 1508 for suggesting shortcuts through the menus. 
PhoneWordMapper 1502 is preferably in communication with a MyMenuData class 1510 for 
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describing the personal use patterns of the user with regard to the menus, and a 
PhoneWorldMenuNode 1512 for providing menu nodes for the previously described graph. 
A Phone WorldLeafNode 1514 is in communication with Phone WorldNode 1504 also for 
supporting the previously described graph. 

The system described provides thre levels of adaptive user interface algorithms. The 
first customization level preferably features a menu item activation shortcut suggestion 
algorithm. This algorithm monitors activations of items using Phone WorldMapper 1502. The 
algorithm monitors the average number of activations of a menu item. When a number of 
activations of a certain item is above a threshold (optionally above average), and the distance 
of the shortcut activation is shorter than that required for the item activation itself, a shortcut 
is preferably suggested. The user benefits from the automatic shortcut, since it reduces the 
number of operations that the user performs in order to activate the desired function. Building 
on this flow, the action generation is a rule based strategy that uses Phone WorldMapper 1502 
as its knowledge base. This algorithm automatically customizes user specific shortcuts. 

The second customization level preferably includes menu item reordering. The 
algorithm monitors activations of items using Phone WorldMapper 1502 and reorders the 
items inside a specific menu according to the number of activations, such that the most 
frequently used items appear first. This algorithm customizes the order of the menu items by 
adapting to the user's specific usage. This algorithm preferably uses the same knowledge base 
of activations as previous algorithm to reorder the menu items. 

The third customization level preferably includes menu composition. The algorithm 
monitors the usage of the items and the menus, and selects the most used items. For these 
items, the algorithm selects the first common node in PhoneWorldMapper 1502 graph. This 
node becomes the menu and the most used items become the node's menu items. This menu 
is preferably located first in the menu system. This also changes the PhoneWorldMapper 
graph to a new graph representing the change in the menu system. This algorithm preferably 
iterates and constructs menus in descending item activation order. 

Section 63: Adaptive System for Games 

This Section describes a preferred embodiment of an adaptive system for games 
according to the present invention. An exemplary game class diagram according to the 
present invention is shown in Figure 146. 

Some of the goals of the intelligent agent are optionally and preferably to entertain 
the user. Also the intelligent agent may optionally have personal goals, for example to 
communicate. 

To manage states of these goals, the system preferably has two classes in game class 
diagram 1600, Figure 146: UserBoredStateHandler 1602 and CreatureStateHandler 1604. 
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Both classes preferably generate actions according to a rule based strategy. The rules 
maintained by the classes above relate to the goals they represent. Both classes use the event 
model as input method for evaluation of the rules and the state change (i.e. both are event 
handlers). 

As an Idle action (ie if not otherwise engaged), the intelligent agent preferably selects 
the MoveAction (not shown), which may also adapt to the user preferences, for example with 
regard to animations, sounds etc. 

The MoveAction preferably first selects between MOVE state or REST state. The 
selection is probability based. In each state, the MoveAction chooses the appropriate 
animation for the state also based on probability. The probabilities are initialized to 50% for 
each option. 

The user input affects the probability of the current selected pair (state, animation). If 
the user gives a bad input the probability of the state and of the current animation decreases, 
and for good input it increases. The probabilities preferably have a certain threshold for 
minimum and maximum values to prevent the possibility that a certain state or animation can 
never be selected. 

A CommAction 1606 is also shown. This action is driven by the goal to 
communicate and is optionally generated by CreatureStateHandler 1604, depending on the 
expressiveness and communication preferences of the user and the intelligent agent 
communication state. For example if the intelligent agent did not communicate with the user 
for some time, and the present is a good time to try tocommunicate with the user (according 
the state handler rule base), a communication action is preferably generated. This action may 
invoke vibrate and or sound, also text communication may optionally be used when possible. 

A behavior display action is optionally and preferably driven by the emotional model; 
whenever an emotional state changes, the intelligent agent preferably expresses the new 
emotional state, optionally by using text, sound, two dimensional and three dimensional 
animations. 

A Game Action 1608 preferably starts a game in the floating application space. This 
action optionally selects one or more objects from the virtual AI World application. The 
intelligent agent explores the object and act on it. For example a ball can be selected, after 
which the intelligent agent can move and kick the ball, the user may move the ball to a new 
place and so on. Some of the objects may optionally be wrapped user interface objects 
(described in the AI world application). This game action is preferably characterized in that it 
is only the intelligent agent that decides to select a possible action without the user's 
reinforcement. 

The HideAndSeek action 1610 uses the PhoneWorldMapper ability to track the 
location of the user in the menu system and in the different host screens. The intelligent agent 



48 



678-1264 (PI 1404) 

preferably selects a location in the menu tree and hides, after which the user navigates the 
menu system until the user finds the intelligent agent or the search time is over. After the user 
finds (or does not find) the intelligent agent, preferably a message is posted which tells the 
user something about the current location in the menu system and/or something helpful about 
the current screen. In this way the user may learn about features and other options available 
on the host platform. The helpful tool-tips are preferably available to the intelligent agent 
through the PhoneWorldNode that contains the tool-tips relevant to the specific node 
described by the object instance of that class. 

A SuggestTmTrivia 1612 may optionally provide a trivia game to the user, preferably 
about a topic in which the user has expressed an interest. 

Section 7£: Teaching System 

This Section describes a preferred embodiment of a teaching system according to the 
present invention, including but not limited to a preferred embodiment of the present 
invention for teaching the user about a subject that is not directly related to operation of the 
device itself. A general description of the teaching machine is provided, followed by a 
description of an optional but preferred implementation of the teaching machine according to 
Figures 157 A (exemplary teaching machine class diagram) and 153B (exemplary teaching 
machine sequence diagram). 

The previously described application layer preferably uses the infrastructure of the 
teaching system to create different teaching applications within the framework of the present 
invention. 

The teaching machine is preferably able to handle and/or provide support for such 
aspects of teaching and learning as content, teaching logic, storage, updates, interactions with 
the intelligent agent (if present), lesson construction, pronunciation (if audible words are to be 
spoken or understood). The latter issue is particularly important for teaching languages, as 
the following data needs to be stored for each language: language definitions (name, character 
set, vowels, etc.); rules (grammar, syntax) and vocabulary. Preferably, a rule is a simple 
language element which can be taught by example and is also easily verified. Vocabulary is 
preferably defined as sets of words, in which each word set preferably has a level and may 
also optionally be categorized according to different criteria (such as work words, travel 
words, simple conversation words and so forth). Other important aspects include context, 
such that for each word w in the vocabulary there should be at least 3 contexts and relations, 
such that for each wl, w2, words in the vocabulary there should be a maximal set of relations. 
A relation is preferably defined as a set of 4 words wl : w2 like w3 : w4. 

The high level teaching machine architecture preferably includes a class called 
TMLanguage, which provides abstraction for the current TM language, allows extension 
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capabilities for the entire TM infrastructure. There is also preferably a class defined as 
TMLesson, for organizing individual lessons, for example according to words in a set, rules, 
quizzes or practice questions, and so forth. 

A lesson period is optionally defined to be a week. A lesson is composed of: a word 
set, which is the current vocabulary for this lesson; a rule set, which may include one or more 
rules taught by this lesson; practice for allowing the user to practice the material; and 
optionally a quiz. 

Figure 15?A shows an exemplary teaching machine class diagram 1700 for the 
teaching machine infrastructure, which is is designed to provide an extensible framework for 
generic and adaptive teaching applications. The application class TeachingMachineApp 1702 
is responsible for providing the runtime and user interface for a quiz based application. The 
application preferably embeds a TMEngine 1704, which is responsible for building the user 
profile (user model) in the examined field. For example if the general field is English 
vocabulary, TMEngine 1704 preferably learns the user's success rate in various sub-fields of 
the English vocabulary in terms of word relations, negation, function, topic and more. 

After analyzing the user's performance in the various sub-fields of the general field 
being taught by the application, TMEngine 1704 preferably directs the application to test and 
improve the user's knowledge in the topics and sub-fields that the performance was weaker. 
TMEngine 1704 preferably runs cycles of user evaluation, followed by teaching and adapting 
to the user's performance, in order to generate quiz questions that are relevant to the new state 
of the user. 

TMEngine 1704 also collects the user's performance over time and can optionally 
provide TeachingMachineApp 1702 with the statistics relevant to the user's success rate. 

The extensible quiz framework is preferably provided by using abstraction layers and 
interfaces. TMEngine 1704 is preferably a container of quizzes; the quizzes may optionally be 
seamlessly since all the quizzes preferably implement TMQuiz 1706 standard interface. Each 
quiz can access and store its relevant database of questions, answers and user success rates 
using the TMDataAccess class 1708. The quizzes and topic training aspects of the teaching 
machine are preferably separated, which allows the adaptive teaching application to operate 
with many different types of topics and to be highly extensible. 

Examples of some different types of quizzes include a TMWordNet quiz 1710, a 
TMTriviaQuiz 1712 and a TMRelationQuiz 1714. 

Figure 152B shows an exemplary teaching sequence diagram according to the present 
invention. Application manager 502 (described in greater detail with regard to Figure 5) 
sends a step to TeachingMachineApp 1702 (arrow 1). TeachingMachineApp 1702 then sends 
a request to TMEngine 1704 to prepare the next teaching round (arrow 1.1). This preparation 
is preferably started by requesting the next question (arrows 1.2.1 and 1.2.1.1) from TMQuiz 
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1706. The answer is received from the user and evaluated (arrow 1.2.2) by TMEngine 1704 
and TMQuiz 1706. If correct, TMQuiz 1706 updates the correct answer count (arrow 
1.2.2.1.1.1); otherwise it updates the incorrect answer count (arrow 1.2.2.1.2.1); the overall 
success rate is also updated. TMEngine 1704 preferably saves the quiz statistics. Optionally 
and preferably, the correct answer is displayed to the user if an incorrect answer was selected. 

The next part of the sequence may optionally be performed if the user has been tested 
at least once previously. Application manager 502 again sends a step (arrow 2). 
TeachingMachineApp 1702 sends a request to prepare a teaching round (arrow 2.1). The 
weakest topic of the user is located (arrow 2.1.1) and the weakest type of quiz of the user is 
also preferably located (arrow 2.1.1.2). For each question in the round, TeachingMachineApp 
1702 preferably obtains the next question as above and evaluates the user's answer as 
previously described. 

This architecture is preferably extensible for new topics and also new quiz structures. 
The new topics preferably include a general topic (such as English for example) and a type of 
content (American slang or travel words, for example). The topic preferably includes the data 
for that topic and also a quiz structure, so that the teaching machine can automatically 
combine the data with the quiz structure. Each quiz preferably is based upon a quiz template, 
with instructions as to the data that may optionally be placed in particular location(s) within 
the template. 

EXAMPLE 3: EVOLUTION SYSTEM FOR AN INTELLIGENT AGENT 

the pre s ent inv e ntion, including but not limited to a description of DNA for th e creature or 
^^tar^eeefdif^te^p^eryed^fl^di m e nt of th e pr ese n t inv e n tienr^n d also a descrip&on-ef 
an optional g e n e studio according to th e pr e s e nt inv e ntion. The evolution system optionally 
and pr e f e rably e nabl es th e cr e atur e or avatar to >c evolv e ", that i s , to alt e r at l e ast one asp e ct of 
the behavior and/or app e arance of the creature. This E?camplc is described as being optionally 
and preferably operative with the intelligent agent described in Exampl e 2, but this 
description is for the purposes of illustration only and is not meant to be limiting in any way. 

Evolution (change) of th e intellig e nt agent is d e scribed her e in with regard to both 
tangibl e f e atur e s of th e ag e nt, which ar e disp l ay e d by th e avatar or creature, and non - tangible 
features of th e ag e nt, which affect th e behavior of th e avatar or cr e atur e . 

Figure 1 8 A. shows an exemplary evolution class diagram 1800. The genetic model 
d e scribed in the class diagram allows various properties of the intelligent agent to b e changed, 
preferably including vi s ual as well as functional properties. The model include s a 
CreotureDNA class 1 8 02 that r e presents th e DNA structure. The DNA structure is a v e ctor of 
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available g e ne s and can pr e f e rably be e xt e nd e d to incorporat e n e w g e n e s. — A g e n e is a 
parameter with a range of poGsibl e values (i. e . genotyp e ). Th e g e n e is int e rpreted by th e 
sy s tem according to the present inv e ntion, such that th e e xpre s sion of the data in the gene is 
its genotype. For e xample the h e ad gene is locat e d as the first gen e in the DNA, and its value 
is expr es sed as th e vi s ual stru ct ure o^ie-ereature^s-aea d , although preferably th e color of th e 
h e ad i s e ncoded in anoth e r gen e . 

In order to e volv e th e intellig e nt ag e nt to achiev e a specific DNA instance that 
pleases the user, the g e netic model according to th e present inv e ntion preferably implem e nts 
hybrid and mutate g e netic operations that modify the DNA. The CreatureProxy class 180 4 is 
responsible for providing an interface to the DNA and to the genetic operations for the system 
cla ss es. C r e atur e Proxy 1804 also pref e rably holds oth e r non g e n e tic information about th e 
int e llig e nt agent (i. e . name, birth dote ? and so forth). 



ag e nt and provid es an int e rfac e to th e Cr e atureProxy 180 4 of the int e lligent agent and its 
genetic operations to applications. 

The EvolutionEnginc class 1808 listens to evolution events that may be generated 
from ti m e to time, for indicating that a certain genetic operation should b e invoked and 
p e rform e d on the intellig e nt agent DNA. The DNA structure is given below. 

DNA structur e 

#ifndcf CREATOR E_DNA 

#dcfin c CREATURE_DNA 

#includc "CrcaturcDcf o . h" 




«s-4806-pi 




rtTTllT^Cllt 




#dcfinc GENE COUNT 19 



#d^M-ne^A-SE-~COi3GR--GENE~-"8- 



fcyp edef — a t ru e t internal _dna 

-f 

un si gn e d char head; 

un oi gnod char hcad_color; 
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un si gn e d char body; 
un s i gned— ehar— bod y_ c o 1 o r ; 
-^nS"i-gned--eha r bo dy _ o c a i c ; 
unsigned char hand; 
-unsigned— enar hand_color ; 
unsign e d ehar hand_ocale; 
unsign e d char — tail ; 
unsigned char — tail_oolor ; 
unsigned char tail_acalc; 

unsigned char lcg__color; 

un si g ned— eha r l c g ^ acalc; 

un s igned char dexterity; 

unsigned char cfficiancy; 

unsi g ned—eha- r i re fe- oractiv c; 

u n si gn e d ch a r baGC _ color; 

-] — intcrnal_dna; 

-feype d ef int c rn a-l_ dna p _i ntcrnalDa a-r- 

* This claso repre 3 c nto t h e Cr ea ture DNA oti ru eture. 

* The DNA hold all the data about the Croat urc body parto and 
some 

* personality and functional qualities 

e-l-a&g — G rcatur c DNA /*■ • publi c CommS c rializabl c */ 
i 

pubi-i-e-r- 

— a tatic conat int genc_count , - 



* dcfualt conatructor, DNA ia i initialized to zero 
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/* 

* Copy con a true tor 

* @par a m other th e UNA t o c opy 

V 

Crcatur c DNA ( e o ns t Cr c Q t ur eBNA-&efe^e^--;- 

/* * 

* Initialization function, — ahould be called if teh 

constructor was not 

*— eaiied-v 

V 

v-e4 d init ( ) ; - 




indoi 



void randomis c Dna () ; 



— ic—spke-BN A actu al— da-fca- 
— V 



un i o n — {- 



te naign o d ch a r data [GENE z €OU^FH- 



* flange of type gene 
static conat int TYPE_RANCE; 
— * Range of color gene 
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otatic c o nst int C0L0R__RANCE ; 

— * R ange of ocale gene 
— V 



* Range of character gene a 



otatic conat int CHARECTER RANCE; 



otatic conat int BASE COLOR RANCE; 



* Loca tio n of ae et l c g e n e in th e t yp e , eel-e r , ocale triplet 



frt-a- t ic c onat int SCALE _LOCATI O N; 



# cndif /*_CREATURE_DNA_*/ 



Intelligent agent DNA construction is preferably performed as follows. — When 

p r o v i d in g a v e rsion of the living mobile phone, the DNA is preferably composed from a Gene 
for each B uil d i ng Block of the intelligent agent. Th e building block can optionally be a visual 
part o f th e ag e nt, pr efe rab ly in cluding col eiHar-seale (siz e of th e building block ), and also 
pr e f e rably including a non visual prop e rty that rel at e to th e functionality and behavior of th e 
int e llig e nt agent This model of DNA compo s ition can be e xtended as mor e building blocks 
can be added and th e e xpression levels of each building block can increase. 

The construction of an intelligent agent from the DNA structure is preferably 
p e rformed with respect to each gene and its value. Each gene (building block) value 
( e xpr e ssion level) d e scrib e s a diff e r e nt g e notyp e e xpr e ss e d in the compos e d ag e nt. Th e basic 
btttiditig-bteeks-^^ o f prototypes 

dictate the rang e of each visual gene. It is also possible to generate in runtime values of 
e xpr e ssed genes not r e laying on prototyp es , for example color g e ne expression level s can b e 
computed as indexes in the host platform color table, or scale also can be computed with 
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respect to the hoot scr ee n size, to obtain g e notypes that ar e ind e p e nd e nt of pr e d e fin e d 
prototypes. Th e prototype model s are preferably decomposed and th e n a non prototype agent 
is-p r ef erably recomposed according to the gene values of ea c h buildi ng block. 

The following example provides an illustrative non limiting explanation of this 



included, but the same proce s s also appli e s to these gen e s; 

A 16 prototyp e and 5 building block v e rsion of DNA may optionally be given a s 

follows: 

DNA p -[[head0:15] , [body,0;15] , [legs, 0:15] , [hands ? 0:15] , [tail, 0:15]) 

Each of the 5 building blocks has 16 different possible genotypes according to th e 
building blo ck g e n e values that ar c d e riv e d from the numb e r of prototyp e models. Wh e n 
composing the intellig e nt agent, the right building block is taken according to the value of 
that building bl o ck - m -the-B NA . which is th e value of its r especti v e gener 

For e xample a sp ec i fi c i n sta nc e of t he DNA sch e m e d escri b ed ab ov e can b e : 

DNA - j [3],[5].[10],[13],[0] ) 



Th e vari e ty of pos s ibl e intelligent ag e nt compositions in this simple DNA version is: 
¥ 0 - (16) * (16) * (16) * (16) * (16) ~ (16) " 5 - 10 4 8576 

If a b ase c olo r g e n e f or describing th e ge n e ral c o l or of th e in te lligent ag e n t (i. e . gr ee n; 
b hi e , and s o forth ) is ad de d, with expression l e v e l of pos s ibl e 16 bas e colors, th e following 
vari e ty is obtained: 



DNAt- 
4{head;0~l 



gs ; 0:15],[hor 



color,0:15]) 



The vari e ty th e n b e come s : 
¥+--^0 * 16 ~(16) 6 - 16777216 

If an intensity gene for th e base color gene (i. o from light color to dark color) is added 
following v a ri e ty is p ref e rab ly obtai n e d : 



DNA^= 

([hoad,0:15] , [body,0:15] , [lego, 0:15] , [hands,0:15] , [tail, 0:15], [bo_color,0:15] ; 
[ i titcnsity ? 0:15]) 
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The variety calculation is: 
V 2 ^V. V * 1 6 ~ (\6f ~ 268135156 



A variety of g e n e tic operations may optionally be perform e d on th e DNA. as 
d escribed with regard to Figure 18B and 18C, which show a mutation sequence diagram and -a 
hybridization s e quence diagram, r e spectively. 

As sh o wn in Figure 18B, th e basi c mutation op e ration pref e rably randomly s e lects a 
g e ne from the gene set that can b e mutated, which may optionally be the e ntire DNA, and 
th e n change the value of the selected gene within that gene's possible range (expression 
levels). Th e basic operation can optionally be performed numerous times. 



create a mutant. — EvolutionMGR class 1 8 06 pas ses this request to CreaturoProxy 1 8 0 4 , 

For e a c h such mutant, CreatureProxy 1 8 04 pr e ferably s e l e cts a r a n d om g e n e (arrow 1. 1.1.1.1) 
and changes it to a value that is still within the gene's range (arrow 1. 1.1.1.2). The mutant(s) 
are then returned to mutate application 1 8 12, and ar e preferably displayed to the user, as 
d e scribed in greater detail below with regard to Exampl e 4 . 

If the user approves of a mutant, th e n mutate application 1 -8 12 sends a command to 
replace the existing-imfile m e n ta t ion o f th e— agent— wit h the n ew n nvta nt (arrow 2.1) t e 

Creatu r-ePr-e xy 180 4 (anew 2.1.1), which pr e f e rably then updat e s th e history of the ag ent at 
agent_history 1 8 1 4 (arrow 2.1.1.1). 

Figure 18C shows an ex e mplary sequence diagram for the basic hybrid operation (or 
cro ss ov e r operation), which occurs wh e n two ca n didat e DNAs ar e oligned one to the other. 

0ne~^r^i0re~eress~<3ve^ 

ov e r point s number can vary from 1 to th e numb e r of g e n e s in the DNA: this numb e r may 
optionally b e s e l e ct e d randomly). The operation of s e l e cting th e cro s sover points is call e d 
gct_cut_indcx. At each cross over point, the value for the DNA is selected from one of the 
existing DNA values. This may optionally be perform e d randomly or according to a count 
called a cutting_index. The result is a mix between the two candidate DNAs. The basic hybrid 
op e ration can optionally be performed num e rou s time s with numerous candidat e s. 

As shown, a HybridApp 1 84- 6 send s a command to EvolutionMGR 1806 to begin the 
proc e ss of hybridization. Th e proc e ss is optionally performed until the us e r approv e s of the 
hybrid agent or aborts the process. EvolutionMGR 1806 starts hybridization by sending a 
command to obtain target DNA (arrow 2.1.1) from CreatureProxy .180 4 , with a number of 
cro ss- overs (hybridizations) to be performed. — As shown, a eutting_ind e x i s maintained to 
indicate when to do a cross ov e r b e tween the values of the tw'o DNAs. 
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Th e hybrid agent i s return e d, and if th e us e r approv e s, th e n the curr e nt ag e nt i s 
r e placed with the hybrid agent as describ e d above with regard to the mutant process. In the 
end, the hi s tory of the agent at agentjristory 1 8 1 4 i s preferably updat e d. 

Hybridization may optionally and preferably b e performed with agent DNA that i s 
seftt-ti^fflha-seure e external to th e mob ile informati o n dev i ce , for example in a SMS message, 
through infrared, BlueTooth or the Internet, or any other sourc e . — For the purpose of 
d escrip tion only and without any intention of being limiting, this process is illustrated with 
regard to receiving such hybrid DNA through an SMS message, — The SMS message 
p refe r ab ly contains the data for the DNA in a MIME type. More preferably, the system of the 
present invention has a hook for this MIME type, so that this type of SMS message is 



pr e ferably automatically pars e d for hybridization without requi ring m anual intervention by 
the user. 

Figure^^hows^n-^^ A s s hown, U s er 

1 se nds a re q u e s t to hybridiz e the int e llig e nt ag e n t of Us e r 1 with that of Us e r 2 through 
Handset 1. User 2 can optionally approve or reject the request through Handset 2. If User 2 
approve s , the hybrid op e ration is perform e d between the DNA from both agents on Handset 

hybrid as a replac ement for th e curr e nt agent. If th e hybrid i s used as the replacement then 

sav e s t o tl^e4iy%rid4<Hhe4w%rid-fe&ij 



EXAMPLE 1: USER INTERACTIONS WITH THE PRESENT INVENTION 

This Example is described with regard to a plurality of representative, non limiting, 
i llustrativ e scr ee nshots, in order to provid e an o pt i o nal bu t pr eferre d e mbodim e nt of the 
systei*M>r : ftei>resenH^^ 

Fig u r e 20 show s an e x e mplary acr ce n s hot of th e "floating ag e nt", which is th e 
cr e atur e or avatar (visual e xpression of th e int e llig e nt ag e nt). Figure 21 shows an exem p l ary 
screenshot of a menu for selecting objects for the intelligent agent's virtual world. 

Figure 22 shows the Start Wizard application , wh ic h allows the user to configure and 
m o di f y t he agent settings, a s well as us e r pref e r e nces. 

On e example of an action to b e p e rform e d with the wizard is to S e t Personality, to 

d e t er min e se t tings for th e e motional sy s t e m of t h e int e lligent agent Here, the user can 

configur e die cr e ature's personality and tend e nci e s. 

The user can optionally and preferably determine the creature's setting by pressing the 
right arrow key in order to increa s e the level of the characteristic and in order to do the 
opposite and decrease the level of the 
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Various charact e ristics such as Enthusiasm, Sociability, Antisocial behavior, 
Temp e r (l e v e l of patience), M e lancholy. Egoistic behavior, and so forth. 

Th e us e r is also pr e ferably able to set User Preferences, for example to determin e 
how quickly to r e c e ive help. Som e oth e r non limiting examples of these pr e f e r e nces includ e : 
eoffl*&uftication ( e xtent to which the age nt^efB^ifflieates); entertain _ user ( c ontr ol s ag e nt 
playing with the user); e nt e rtain_self (controls agent playing alon e ); pres e rv e _battery 
(extends battery life); and transpar e ncy Jev e l (the l e v e l of th e transparency of th e creatur e ). 

The user also pref e rably sets U se r D e tail s with the start wizard, preferably including 
but not limited to. us e r name, birthday (according to an optional embodiment of the present 
invention, this value is important in Hybrid SMS since it will define the konghup possibility 
b e tw ee n users, which is the ability to create a hybrid with a favorabl e astrology patt e rn; the 
konghup option is built according to suitable tabl e s of horsocope s and dates), and gend e r. 

The-ttser can al s o preferab ly se t Cr e a tur e D e tails. 

Figure 23 shows an e x e mplary m e nu for p e rforming hybridization through th e hybrid 
appl icat ion as previously described. 

Figur e 2 4 A shows an e x e mplary scr e enshot for viewing a new creature and optionally 
gener a ti ng again, by pr e s si ng on the G e n e rat e button, which enables th e us e r to gen e rat e a 
creature randomly. Figure 2 4 B shows th e r e sultant creature in a screenshot with a Hybrid 
buttenr-p r es sing on this b ut ton co n fi rm s th e us e r's cr e atu re selec tion and pa sse s to the 
cr e atur e pr e vi e w window. 

3%e-pgev iew wind ew-atio wa th e us e r to s ec th e n e wly gen e ra te d creatur e in t hr ee 
dimensions, and optionally to animate the creature by using the following options: 

4-: — N a v igati o n UP key: Zoo m In and minimi ze s the siz e of th e cr e atur e . 
i — Navigatk>f^D0WN4veyH^ 

3. Navigation LEFT key: Switch b e tw e en the "Ok" and "Back" button s . 

4. Navigation RIGHT key: Switch between th e "Ok" and "Back" buttons. 
— Ok key (OK): Confirm selection. 

6. Clear key (CLR): Exit the creature preview window to Living Mobile Menu. 
l- t — End key: Exit the creature preview window to the main menu. 

8 . '0 T key: Lighting and shading op e ration on the creature. 

9. T key: Circling the cr e atur e to the left with th e clock direction. 

10. '2' k e y: Circling th e creatur e in th e 3D. 

1 1 . '3* key: Circling th e creature to the right against the clock direction. 

12. '5' Key: Circling the creature in the 3D. 

13. '6' key: Animates the creature in many ways. Every new pressing on this key 
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Th e animations that th e cr e ature can p e rform optionally include but are not limit e d to, 
walking, sitting, sm e lling, flying, and jumping. 

Figure 25 shows an exemplary screen shot of the hybrid history, which enable s th e 
us e r to revi e w and explore the history of th e creature's changes in the generations. The user 



parents. Preferably, for ev e ry creatur e th e r e can be at mo o t 2 par e nts. 

Figur e 26 shows an e x e mplary screen shot of the G e n e studio, with the DNA 
S e quenc e of th e current creature. The gene studio also preferably giv e s the opportunity for 
the us e r to change and modify th e agent's DNA sequence. 

EXAMPLE 3$ -INTELLIGENT AGENT FOR A NETWORKED MOBILE 
INFORMATION DEVICE 

This example relates to the use of an intelligent agent on a networked mobile 
information device, preferably a cellular telephone. Optionally and preferably, the intelligent 
agent comprises an avatar for interacting with the user, and an agent for interacting with other 
components on the network, such as other mobile information devices, and/or the network 
itself. Preferably therefore the avatar forms the user interface (or a portion thereof) and also 
has an appearance, which is more preferably three-dimensional. This appearance may 
optionally be humanoid but may alternatively be based upon any type of character or creature, 
whether real or imaginary. The agent then preferably handles the communication between the 
avatar and the mobile information device, and/or other components on the network, and/or 
other avatars on other mobile information devices. It should also be noted that although this 
implementation is described with regard to mobile information devices such as cellular 
telephones, the avatar aspect of the implementation (or even the agent itself) may optionally 
be implemented with the adaptive system (Example 2) and/or proactive user interface 
(Example 1) as previously described. 

Th e int e lligent ag e nt of th e pr e sent invention is targeted at creating e nhanc e d 
e motional experience by applying the concept of a "Living Device". This concept preferably 
i nclud es both emphases upon th e uniquenes s of th e intelligent ag e nt, as every living creature 
is unique and special in app e arance and behavior, whil e also providing variety, such as a 
variety of avatar appearanc es to e nhanc e the us e r' s int e raction with the living device. The 
avatar pr e ferably has comp e lling visual properti es , optionally with suitabl e supplem e ntary 
objects and surrounding e nvironm e nt. 

The intelligent agent preferably displays intelligent decision making, with unexpected 
behavior that indicat e s its self existence and independent learning. Such ind e p e ndent b e havior 
is an important aspect of the present invention, as it has not been previously demonstrated for 
any type of us e r interface or int e raction for a us e r and a computational d e vic e of any typ e , and 
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has certainly not b e en us e d for an intelligent ag e nt for a mobil e information d e vic e . The 

int e lligent agent also pr e ferably e volves with time, as all living things, displaying vioual 
change. Thi s i s one of th e most important "Living Devic e " prop e rties. 

Th e e volution s t e p init i at es a n e mo t ional r e sponse from the user of surpris e and 
anti cipation for the nex t evolution step . 

Evolution is a visual change of th e creatine with respect to tim e . The time fram e may 
optionally be s e t to a year for exampl e , as this is the lifeoycle of midrang e cellular t e l e phone in th e 
market Bulling the year, periodic changes pr e ferably occur through evolution. The evolutionary 
path (adaptation to the environm e nt) is a r e sult of natural selection. Th e natural selection can 
optionally be user driven (i. e . user decides if the next generation is better), although another option 

The intelligent agent may optionally be implemented for functioning in two "worlds" or 



di ff erent e n viro nm e n ts: the-telephot 



a n e ( mo bile 



information d e vic e ) world e nabl es th e int e llig e nt ag e nt to control differ e nt functions of th e 
telephone and to suggest variou s function selections to the user, as previously desciibed. Preferably 
the intelligent agent is able to operate on the basis of one or more telephone usage processes that 
ar e model e d for the agent to follow. Anoth e r i mp or tant aspect of the telephone world is e motional 
e xpressions that can be e ith e r graphic expr e ssion s such as breaking the screen or free drawing or 
f acial a n d te xt exp ressiens^ite-er^^v^ : elev^nt-werds f or the s p ecif i c cas e. 

The virtual world is preferably a visual display and playground ar e a, optionally wh e r e 
ot^^is-etha-^han^he-a^tar- ^an b e ins e il ed^ty-tl : te^^f : -ean-f>bsei : \ r e th e a vat a r lea rning and 
interacting with them. The objects that are entered to the world can optionally be predefined, with 
possible different behaviors resulting from th e learning process. The user can optionally and 
pr e f e rably give rewards or disincentives and be part of di e learning process. In tliis respect, the 
^^feeugl^e^pearanee^ 




Som e pr e f e rr e d asp e cts of th e intellig e nt ag e nt include but ar e not limit e d to, a 3D 
graphic infrastructure (with regard to the appearance of the avatar); the use of AI and machine 
l e arning mechanisms to support both adaptive and proactive b e havior; the provision of 
gaming capabiliti e s; th e ability to enhance the usability of the mobile information device and 
also to provide sp e cific user assistance; and provision of a host platform abstraction layer. 
Tog e ther, these features provide a robust, comp e lling and innovative content platform to 
support a plurality of AI applications all gen e rically defin e d to be running on the mobil e 
information devic e . 

The avatar also preferably has a number of important visual aspects. For example, 
the outer clip size may optionally be up to 60 x 70 pixels, although of course a different 
resolution may be selected according to the characteristics of the screen display of the mobile 
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information device. The avatar is preferably represented as a 3D polygonal object with 
several colors, but in any case preferably has a plurality of different 3D visual characteristics, 
such as shades, textures, animation support and so forth. These capabilities may optionally be 
provided through previously created visual building blocks that are stored on the mobile 
information device. The visual appearance of the avatar is preferably composed in runtime. 

The avatar may optionally start "living" after a launch wizard, taking user pref e r e nc e s into 
account (user introduction to th e living device). In addition to evolution, di e avatar may optionally 
display small visual change s that represent mutations (color change / movement of some key 
vertices in a random step). Visual evolution step is preferably performed by addition / r e placement 
of a building block. — The avatar can pr e f e rably move in all directions and rotate, and more 
pr e ferably is a folly a ni mat e d 3D character. 

The avatar is preferably shown as floating over the mobile information device display with 
the mobile information device user interface in the background, but may also optionally be 
dismissed upon a request by the user. The avatar is preferably able to understand the current user's 
normal interaction with the mobile information device and tries to niinimize forced 
hiding/dismissal by the user. 

According to op t ional but pre f erred e mbodiments of th e p res ent inv e ntion, the avatar 
can be p rogramm e d to "move" on the screen in a more natural, physically realistic mann e r. 
Fof~ex^iipler--vaf^ 

Examples of such -algori thm s and - paramct c rs ar e d es cribed in "Automatic Generation of 

Motion", A. Ude et al, Proc. First IEEE RAS Int. Conf Humanoid Robots (Humanoids 
2W 0), Cambridg e , MA, USA, Sept e mber 2000 (h e r e by incorporated by referenc e as if fully 
se^^th^erei^ 

m e thods for automatically translating th e captur e d data into humonoid robot kinetic 
param e t e rs. Bri e fly, both human and robotic motion ar e mod e led, and the mod e ls ar e used 
for translating actual human movement data into data that can be used for controlling th e 
motions of humanoid robots. 

This type of ref e rence is us e ful as it provides information on how to model the 
mov e ment of th e humanoid robot. Although th e pr e s e nt inv e nti on is concerned with r e alistic 
m ov e m e nt of an avatar ( vir t ual ch arac t e r be ing de pict e d thr ee ■ dim o nsionaUy), s imilar mod e ls 
could optionally be us e d for the avatar as for th e humanoid robot. — Furthermor e , a mod e l 
could also optionally be constructed for modeling animal mov e m e nts, thereby permitting 
mor e realistic movement of an animal or animal like avatar. More g e nerally, preferably th e 
system can handle any given set of 3D character data gonerieally. 
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Th e s e models could also optionally and pr e ferably b e us e d to p e rmit die mov e ment of 
th e avatar to evolve, sinc e diff e r e nt param e ters of the model could optionally b e alter e d 
dur ing the e voluti o nary proc e ss, ther e by changing how t he avatar moves. Such mod e ls ar e 
also preferably u s eful for d e scribing non d e terministic movement of th e avatar, and also 



b e havior also h e lps to maintain the inter e st of th e us e r. 

According to oth e r pr e ferred e mbodiments of the pres e nt inv e ntion, the behavior of 
the avatar is also optionally and preferably produced and managed according to a non 
deterministic model Such mod e l s may optionally b e written in a known behavioral language, 
such as ABL (A Behavioral Language), as described in "A Behavior Language for Story- 
Bas e d B e li e vabl e Agents", M. Ma teas and A. St e rn, W&Fkifig-N&f&wf^rtijte 
and I nteractive Entertainment. AAA! Spring Symposium Scries, AAAI Press, USA, 2002 



rferene 



*nce d es crib e s ABL. 



which can b e us e d to cr e at e virtual charact e rs that b e hav e in a r e alistic mann e r. Such r e alistic 
behaviors include r es ponding to input, for example through speech, and also movement 
and/or gestures, all of which provide realistic communication with a human user of the 
so ftwar e. — It should be not e d that by "movement" it is not n e cessarily m e ant modeling of 
mov e ment which is r e alistic in appearance, but rather supporting movement which is realistic 
in-ter m s of th e con text in w hieh-it occurs. 

Such a languag e , which includ es v arious inputs and outputs, and which can b e us e d to 

optionally be used for the behavior of th e avatar according to the present invention. — Fer 
example, the language describes "beat idioms", which are examples of expressiv e behavior. 
Thes e b e at idioms arc divided into thre e cat e gories: beat goals, handlers and cros s b e at 



behaviors™ 



^al^-are-behavieFS-wl^ 



3BBe d in t h e-eente^t-^f-a-^artieulBf 



situation, s uch as gre e ting th e human us e r. Handl e rs ar e r es ponsible for int e ractions betwe e n 
th e human user and th e virtual creatur e (for exampl e th e avatar of the pr e s e nt inv e ntion), or 
for interactions betwe e n virtual creatures. Cross beat behaviors allow the virtual creature to 
mov e between sets of behaviors or beat idioms. Clearly, such constructs within the language 
could optionally be used for the avatar according to the present invention. 

Of course it should b e noted that ABL is only one non limiting example of a 
believable agent language; oth e r types of languages and/or models could optionally be used in 
place of ABL and/or in combination with AB L. 

The avatar also preferably has several emotional expressions, which do not have to be 
facial but may instead be animated or text) such as happy, sad, surprised, sorry, hurt, or bor e cL for 
example. Emotional expres s ions can be combined. 
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The avatar may also seem to change the appearance of the screen, write text to the 
user and/or play sounds through telephone; these are preferably accomplished through 
operation of the intelligent agent. The agent may also optionally activate the vibration mode, 
for example when the avatar bumps into hard objects in the virtual world or when trying to 
get the user's attention. The avatar may also optionally appear to be actively manipulating the 
user interface screens of the telephone. 

In order to implement these different functions of the avatar and/or intelligent agent, 
optionally and preferably the intelligent agent may be constructed as described below with 
regard to Figures 7-12, although it should be noted that these Figures only represent one 
exemplary implementation and that many different implementations are possible. Again, the 
implementation of the intelligent agent may optionally incorporate or rely upon the 
implementations described in Examples 1 and 2 above. 

Fi gur e 2 7 is a sch e matic block diagram of an int e llig e n t ag e nt syst e m 2700 a c co r di n g 

d e vice 270 4 , which for the purpose of thi s example may optionally be implemented as a 
cellular t e lephone for illu s tration only and without any intention of being limiting. A second 
user-2-70 6 controls a s e cond mobil e information d e vic e 2 -708 . First mobile information d e vi ce 
2704 olid 5eeond , "iT^obi4^~i - H.foi motion device 2708 
274-Or^fer-exa m ple t h roug h m e s saging. 

Each of fm t-mebfle info rffl^oB^ev4ee-^-704- 
270 8 pr e f e rably f eat ur e s an int e llig e nt ag e nt , fo r-i^teraete-g 
and 2706 and also for int e racting with me other intelligent agent. — Therefore, as shown, 
system 2700 enables a community of such intelligent agents to interact with each other, 
and/or to obtain information for th e ir respective users through network 2 74 0, for exampl e . 

The4ntera€tiens^t^is^ 
d e vic e s 270 4 , 270 8 pr e f e rably includ e th e r e gular operation of th e mobile information d e vic e , 
but also add the n e w exciting functionaliti e s of "living mobil e phone". Th e s e functionaliti e s 
preferably include the intelligent agent but also the use of an avatar for providing a user 
interfac e and also more pr e ferably for providing an enhanced user emotional experience. 

The intelligent agent preferably features an "aware" and intelligent software 
framework. The inner operationg of such a system preferably involve several algorithmic 
tools, including but not limited to AI and ML algorithms. 

Syst e m 2700 may optionally involve int e ractions b e tween multiple users as shown. 
Such int e ractions increase the usability and enjoyment of using the mobile information devic e 
for the end user. 

Figure 28 shows the intelligent agent system of Figure 27 in. more detail. As shown, 
a - first in telligent ag e nt 2 800- i s- optionally and preferably able to op e rate according to scenario 
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data 2 8 02 (such as the previously d e scribed knowl e dg e ba se ) in ordor to be ablo to take 
actions, learn and make decisions as to the operation of the mobil e information devic e . Th e 
learning and developm ent pr o c ess of first intellig e nt ag e nt 28 00 is preferably supported by an 
e volution modul e 2 804 for evolving as pr e viously describ e d. If first intelligent ag e nt 28 00 
communi cate s with the user through an avatar, according to a pr e f e rred embodiment of th e 
pr e sent invention, then an animation modul o 2 8 06 pref e rably supports th e appearanc e of th e 
avatar. 

First intellig e nt ag e nt 2 8 00 may also optionally communicate through the network 
(not shown) with a backend server 2 808 and/or another network resourc e such as a computer 
2810, for example for obtaining information for the user. 

First intellig e nt ag e nt 2800 may also optionally com m uni c at e with a second 
intelligent agent 2812 as shown. 

Figure 1629 shows a schematic block diagram of an exemplary implementation of an 
action selection system 2900 according to the present invention, which provides the 
infrastructure for enabling the intelligent agent to select an action. 

Action selection system 2900 preferably features an ActionManager 2902 (see also 
F i g ure 10 for a d e scription) , which actually executes the action. A BaseAction interface 2904 
preferably provides the interface for all actions executed by ActionManager 2902. 

Actions may optionally use device and application capabilities denoted as 
AnimationManager 2906 and SoundManager 2908 that are necessary to perform the specific 
action. Each action optionally and preferably aggregates the appropriate managers for the 
correct right execution. 

AnimationManager 2906 may also optionally and preferably control a 
ChangeUI Action 2910, which changes the appearance of the visual display of the user 
interface. In addition or alternatively, if an avatar is used to represent the intelligent agent to 
the user, AnimationManager 2906 may also optionally and preferably control 
GoAwayFromObjectAction 2912 and GoTowardObject Action 2914, which enables the avatar 
to interact with virtual objects in the virtual world of the avatar. 

Figures JJ7^0A and 1_730B show two exemplary, illustrative non-limiting screenshots 
of the avatar according to the present invention on the screen of the mobile information 
device. Figure JLZ^A shows an exemplary screenshot of the user interface for adjusting the 
ring tone volume through an interaction with the avatar. Figure _17*0B shows an exemplary 
screenshot of the user interface for receiving a message through an interaction with the avatar. 
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While the invention has been described with respect to a limited number of 
embodiments, it will be appreciated that many variations, modifications and other 
applications of the invention may be made. 
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